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ABSTRACT ' 

This handbook for state and lopal education agencies 
is intended as a reference- to assist in ini€lating and/or improving 
follow-up systems or studies of former vocational students classified 
as special populations, TheiJhandbooK is a co m piemen t 't^o Evaluation, 
Handbook! Gnidelines and Pyac^'ces for PoUbw-Op Studies of Former 
Jfocatioaal Students, Volume 1 <se© NoteV. Sections 1, 2, and 3-'. 
p^'ovid© a betckground on ©valuatior a*^ ! followup and an.*overview ©f" 
special populations which hlohliohts def ini*iCnal ^issues an:^ defines 
the = importance of evaluation a?id followuo. j Specif ic titles are • > 
Introdustioni Evaluation F.ollow-pp! Context ^^Definitions, Mo^elii', 
and Relationships! and OveVview of Soecial Populations. Sections U , 
5, and 6 focus on the procedural steps required in designing, 
planning, implementing, and uplno follow-up studies (Issues and* 
Strategies for Pollow-Op of Special l»opulat!ons. Procedures and 
Practices for Follow-op Sandiest, «nd Osing Follow-Ot Data and . 
Studies), Where apptopria'te, clta*ions are made etc Volume 1 and 
information or textual j^aterial is taken from that document to 
support this volume. Other sec^'iors < nc^ude q alossary,* annotatei 
bibliography, and a ppend ^ xes ir.cluding Jkmple materials and foll';»w-up 
questionpairep,. forms, and irtervfew ouTdes. (?LB) - 
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UndQf Contsaet m, QM 300*7 §00 3 2 
Th@ National QontQ^ Mission itateroent 
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Thd National Center for R@s@areh in Vocational Eduea- 
tion's mission is to iner@as@ th@ ability &£ div@rs@ ag^^i^s^ 
institutions., and organizations ^ to solve @dfucational problem's 
relating to individual career planning, pi^eparation, and' 
progreiision. Th© National Center fulfills its mission byi 

. . ' .0 *' 

. . Ganerating- knowledge through research ' ' 

Q D^@lQping ©duoational programs an^ produets 

o Evaluating individual program n@@ds anj outcomes 

« o Installing educational programs and products 

• * » • 

"i. ■ ■ ■ . 

o Operatin'g information systems and services 

o Conducting leadership development and tr&iaing 
. programs , . ' ' 
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Th© material, in this publication 'was- prepared pi^rsu'fiiht 
to a ponttact with the Bureau of OecupajtionaX and" Adufi 
Education, U, 'S. Office of Education> U. >S; Department - 
of Health, Education, and Welfare. Contractors under- ^ 
taking such projects under government spoJiUorship are 
encguraged to freely express thei^ judgment in profes-V ^ 
sional and technical matters. Points "of; view or opinions 
do hot, therefore,! necessarily represent^'-bf f icl^l Bureau 
of Qccupational arfd Adult Education, U..S; Office of V '"' 
.Education position or policy. , ' . ♦ ' * 
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FORET*»ORD / ' • 

* 

The cQx\c®t^ for providing. effactlve and efficient 
education, and enploymeijt and^^raining programs for special 
populations (women, rpinorities," limited English-speaking, 
disadvantaaed,^nd handicapped) stems from' the basic right 
of individ\^a3s to eq.ual educational and employment opr 
portunity." Federal legislation over the past two decades 
reaffirms this belief and progress toward achieving equal 
opportunity for special populations remains a high priority 

Vocational e'dijcators responsible for the development . 
aiid administration of qrocrrams for special populations 
. mffet emphasize the importance €t evaluation. To validly 
assesa prograrf efficiency and effectiven^g th#y must use 
the best evaluation methods and techniques. Moreover, 
evaluation of. vocational education must be a continuous 
process in which the primary ob'jective is providing data 
and information for improving th^ pi^ocesses and products of 
vocational education. The prese^itatiort of folCow-up as #i 
subsystem of t com:>rehensive evaluation effort concentrates, 
on the collectipn- of data and information for program 
improvement. 

4 . ' 

i 1 * 

Recooi\izing the need tc improve vocational education 
follow-up - studies , the Bureau of Occupational and Adult 
Education,' under terms of the U. S, Of^^^^g^^f Education 
contracted with The National Center for Research in 
\Vocational Education to develop ^ two. handbooks on follow- 
Sip studies, "^his handbook on fcllow-up studies of special 
populations is a complement to Evaluation Handbook : . , ; 
Gu idelines' and Practices tor Conducting Fol3;OW~up Studies , 

V o lume . One . '""^ ' \ 

- - ^ 

^he handbook is designed to stimulate dialogue, change, 
and i,<hprovement in -vocational education for special popula- 
tions. It i.^ specifically addressed to program administra- 
tors, Q^valu^ors, and other prpfessionals engaged in this ^ 
important work. 

' This volume does not provide absolute answerk for 
improvirta follbw-up studies but it does identifyj current 
problems and issues along wit^ existing practic^ which * 
have proved successful. Obviously ,. there is* a-^continuing 



n@Qd for improv©mGnt in dgfining effieient and ©ffectiv© 
t©ehniqu©g and practices. Te this ©xtent*, this effort ia 
viewed as ont proc©gg for improving follow-up studies 
of sp©eial populations. 

Th@ National Center is partieularly indebted to 
St©ph©n J. Franchak, Projaot Director, and Janet £. Spir©r, 
Graduate Research Associate, who prepared this document. 
Significant contributions t© the handbook were also mMe 

L. McCaislin, Associate Director, and F. L. McKinney, 
Program Director of the Evaluation and Policy Divisio^i- 
where the project was conducted. Othrer members of the 
evaluation\staff who contributed ideas and assisted in the 
review prbdtess were Marion Franken ant William Stevenson. ' 
Also, we wiah to acknowledge the advice oh the handbook^ 
contents offered from Dessie D. Page, and Lorella McKinney 
who assisted in the review process. . < 

Recognition and -.appreciation are extended to L. Allen 
Phelps, Assistant Professor, University of Illinois, and 
Larry Thornton, bradua^te Assistant, the Pennsylvania S^ate 
U|riversity, for major assistance in writing Section 4./° 
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of Wisconsin-Madison; John E. Lutz°, Associate Professor', ^ 
National Technical Institute for Deaf, Rochester Institute 
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Pennsylvania. Finally, a special Viote of appreciation is 
extended to Marlene Linton and Roseahn Pavlp.ck who" typed 
the manuscript for this publication. ♦ . 
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' SECTION 1 , 
INTlioDUCTION 



During the -1960 's and early 1970 's concerns were raised 
about evaluation and follow-up. Question? asked included: 

o What is comprehensive, evaluation and what is 



follow-up? 




b * Wha-t is the relati9nship between evaluation* 
and follow-up? 

o What constitutes effective ar\d efficient 
evaluation or follow-up? . 

o What are thje/outcoires of evaluation'' or follow-up? 

« ■ ». 

o What are commonalities and differences between 

state education agency .evaluation or follow-up 
and local education aaency evaluation or follow- 
up? ^ 

o Hpw do we use the data and information from , 
evaluation or follow-up? 

These basic guestions were often raised and more complex 
ones discussed. As a result of these concerns and the 
discussions which followed, the definitions, purposes^ 
practices and utility of evaluation, or follow-up ^eem '€o 
be in flux and transition. However, the need to improve the 
evaluation process and use the« outcomes from thdt effort 
is paramount.. 

The evaluation of vocational education is essential 
for its continuance and irpr overrent . State and local 
requirements for cost-effective education j:iave been given 
more attention in recent years. Dec.lirt'ing' financial 
resources and a fluctuating labor market demand have caused 
educators to be more responsive to the need for evaluation. 
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•^rther, the importance magnified in tbe current federal 
vocational legislation, Pequirements for fojnnal evalufif^.ibn ' 
procedures and accountability .reports. , are' jiocument^d. 

This sectd^ provides a framework: for thife development 
of a rationale for the design, c(^nduct imd^us.e of follow- 
up studies of special popoiliations . Tfi6 'definition- of "follow 
up" as a subsystem of a "cbmprehensive evaluation system" 
is highlighted. Three basic issues qdnsidered important 
for the development of a rationale include: 

' ' ' ' I ' 

o A definition of follow»-up . / ^ 

A / ^ I •• , 

o . Purposes for conducting a follow-up study 

o Relationships between fpllow-up studies for hon- 
special p9pul,atioris and. for special populations 
receiving yocational education 

A Definition. of Fpllow-up 

- The definitions o| follow-up are many and varied. They 
vary with respect to vocational progr^ area, teacher, 
local administrator, state administrator or program- person, 
and .federal admisnistrators , However, there is a common 
^heji^e evident in ipost definitions. Good's' description seems 
,to 'capture that commonality: ' ' . ■ 



an oraani,zed plan for ascertaining the. 
employment and educational status /of graduates 
froiP vocational programs in orderi^to establish 
the . relationship between employment and., the 
vocational training received, 1 » 



0 



The only borrectipn' which should be offered to that 
definitior\ is the substitution of "former vocational 
education students — completers leave rsf, ahd dropouts" 
for graduates. For ^the purposes of this handbqbk follow- 
up is defined simply as ,the "collection of information 
about program completers, leavers, and dropoutisr^* 

Good defined a follow-up study as: 

(1) a study made in 9^der to achieve dfie or more 
of the following 'purposes : 

(a) to determine th^-i^f fectiveness of the 
guidan^ process 
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(b) to obtain; a realistic^ picture of 

what liesahfead for present students 



, ♦ /(c) to help former students, reappraise, j. 

their educational and vocational pr&ns, , 

(d) to appraise, the school' s 'program, ' 

» (e> to obtain, ideas for improving the 

progrdfn, "and • * 

j:f)''to obtain informatim that the school 
reqifires to adapt its adult education 
profiriram tp meet more efficiently the 
needs of its former students and the . » 

community, \ i 

(2) evaluation of progress of persons in jobs 

dr^training to which they .ti lave been assigned, 
-on the basis of certain mefisuring? instruinents 
and procedures 1 2 ^ 

^ ■ 

The concept of "folldwr\ip" may be better under*stood when 
placed in a broader context.' Pollow-up i^ a subsystem of a 
compr;eheftsive ^evaluation system perceived as having methods 
and tecMiques. for assessing the ^outcomes of a vocational 
edCicatioii program. Like all other evaluation techniques, 
the follow-lip studies are -de s-igned to -gather and provide 
useful information for decision-making^ Therefore, 
a major** goal of evaluation 'is* td^. improve the program 
activity being examined. 



Purposes for ConduQ.ting Follow-up Study * ' ' 

hs the importance of vocational traijdi'ng become* ^mcre 
fully* recognized and as more tax dollar^ are being in- 
vested in vocational educpition^ preciae arid accurate 'in- 
formation is being demanded by thoseyindividuals tesppndible 
* f or approv<ing progi^ajn expenditures. /Moreover, ^s yocational 
administrators are' being held increasingly accountable for 
their actions, the need for documg^htation of program ' ef- 
fectiveness becomes imperative. • ' ' ^ 

This thrust is evident in the states' repot^ting re- • 
'quirements of ,the Education Amendments of 19 76/ Further',. 
Vhe proposed Nationc^l Center- for Educational Statistics' 
Vocational Education Data System (VEDS) reflects the in^ , 
creased concern fop follow-up studies which can provide /■■ 
indices for me^iftrinq vocational program ef fe<^tiveness. ' 
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The discxission below highlights the purpose -for con- 
ducting follow-up. s.tudies fijom two perspectives: the 
proaram improvement perspective Ind the legislative 
perspective., Although the two perspectives are inter- 
related, in that program , improvement is a major intent 
in the federal legislation , many individuals from the 
state and local education agencies view the^egislative 
perspective as one which focuses on data collection for 
compliance. A 

The progr'am improvement perspective focuses on the need 
for reliable and valid evaluation data. Local and state 
administrators need these data to help in making program 
decisions concerning subject matter content, instructional 
methods, instructional personnel^, etc. And the need to 
imj^rove the aecision-making process continues to be a high 
priority. The evaluation literature • shows that -the primary 
purpose of e,valuation is to facilitate decision -making. 
Edwards, Guttentag and Snapper in defining ^the impedance ^ 
and relationship of evaluation to decision-making ^ocess 
state: "Evaluations, ve believe, exist (or perhaps only 
should exist) ^o facilitate decision -making. "3 

The- legislative perspective in the past and present • 
decade is characte^riSed by the need to report the attain- 
ments of vdcational education prbgrams to state and federal 
government. However, vocational, educators still find it 
difficult to obtain the required information andlreport %t 
accurately. Lack of a fully developed data colL^tion and 
disseniination system was. cpnsid$red one of jbhe i^&r limita- 
tions in obtaining and repcrting vocational eduJ^Son data 
ir\ the past decade. 4 More recently, a report of the 
Committee on, Education and Labor of 'the U. S. House of 
Representatives states: C , ' 

the" lack of adequate data has hampered attempts 
at evaluation of the. effectiveness of the voca- 
tional education programs by Congress and has 
pampered the program administrators from of- 
" ■ faring courses most directly related to job 
• demand. The truly unfortimate thing about 
this situation is that it is a failing which 
could have- been avoided years ago. 5 

(■ • 

There is a continuing concern about the lack of com- 
plete and reliable information regarding the ways in 
which federal; state' and l«5cal funds are usQd to realize 
thp basic purpose's of federil vocational education policy. 
Previous, to the enactment of the 1976 Act, a. .1974 Govsxni- 
monfe^' Accounting, report stated that Congress^/ha'd'observed 
rc*peatGdly that information about Vocational .education was 



inadequate for the purpose of formulating public ^policy and, 
•ascertaining wl^ether programs are working properly. 6 
Moreover, the findings cel^cerning the need for accountability 
and the man,dates in th^ Education Amendments of 1976 'con- 

. corning vocational education ^valuation require a comprehensive 
evaluation system. One vital and necessary activity for both 
state and local vocational e^ducation agencies in supporting 

• a comprehensive evaluation system is that of follow-up. . 

The need for evaluation, particularly with the focus on 
outcome evaluation, is emphasized in .the Education 
Amendments of 1^76; ' • . - „ 

. - , . i > 

Public Law 94-'482, Title II Vocational Education, 
Section 112 (b.) 1 1) /states In order for 'the states 
to assist local eduratfonal agencies .and other re- 
' cipients of funds in 'operating the best possible 
Programs of vocational education — 
./ • ■ • • 

(A) each st^te shall, during the five-year period 

the state jjlan, evaluate the .effectiveness of 
each oroarai)^ wi^h the state being assisted with, 
funds f^vailable under this Act; and the results* 
of thQse 'evaluations shall be used to revise the 
state's programs* and shall be made readily available i 
to the state advisory council; and » 

^B)^ each state shall evaluate, by using data collected, 
•wherever possible, by statistically valid sampling 
te'chniques , , each such program within the state which 
purports to' impart entry level job skills according 
to the extent to which program completers and' 
leavers-- ' 

li) find employment in occupations related ^ 
to their training, and 

(ii) are considered by their employers l^o be well- 
trained and prepared for employment, except 
that in no case can pursuit of additional* 
education or training by program completers 
. ' or leavers be considered negatively in thfese 

evaluations. ^ ^ / 

V 

(2) Each state, in* formulating its plans to fulfill 
these 'requirements, shall annually consult with 
the state advisory council which shall assist 
tHb state inv developing these plans to monitor the 
ovaluations conducted by the st^te, and use the 
results of these evaluations in compiling its ^ 
.annual report required by Section 105." 



The legislation also recfuires* that attention be given 
to \£ocational education programs for special populations 
(e.g. , disadvemtaged, handicapped, minorities, limited 
English speaking, ^d w«nen) . Follow-up information about 
special populations must, at 'the minimum,, be based on the 
same evaluation criteria as for all vocational stydents.* 

The number of follow-up Studies of special populations 
in the literature is limited. In cases where studies ap- 
pear, the focus is generally upon the handicapped (e;g. , 
he^aring impaired, visually handicapped) . Given the 
diversities of the special populatjions , meiny questions . " 
about conducting foll«w-up studies are raised when special 
'pot\ulations *are under ^consideration. Examples of questions 
commonly asked include: ^i^hat is the most efficient and 
effective method for gathering data or information? 
What constitutes a "good questionnaire"? and Hdw do you 
increase the response rate? These ques4;ions in regard to 
follow-up of the special populations are similar to those 
addressing the follow-up of non-special populations. 

Commpnalities and Difference-s Between Follow-i^^ Studies 
of Special and Non-Special V^cationa! Education Students 

There are unique characteristics which, apply to each 
special population. 'FollW-up stud.ies of special popula'- 
tions are similar 4.n desigfn--sampling, data and informa- 
tion, data analysis, and reporting techniques. But certain 
procedures or techniques may vary based upon t|;ie character- 
istics of each special population-. Typically, respondents ■ 
are asked standard questions ali^out their current job: 
number of hours employed, wages or salary, job functions — 
some reflections about their 'vQcational preparation, 
instructors, etc. But there are other important types of 
information that should be gathered in order to aid in 
making decisions about the vocationa;l education program. 
An exhaustive list of inquiries could never be developed 
because each vocational education program has its own 
needs. The following questions, however, illustrate some 
special data concerns for follow-up of special populations: 

o Is. the female head of the household unable to 

find a job because she is unable to find day care 
services? Does she lack self-conf idepce because 
she never was employed or it has been a number 
of years since she was employed? 

*Sc?e Section d 14. 402, Federal Regulations, October 7, 1976. 
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Is the Vconomically disadvantaged student uAalble 
to find a^ijob be ^ause she/he cannot afford the 
transportation to and from work? 

Is' the academically disadvantaged student unable 
, to find a job because she/he cannot complete the 
application or pass the employer • s ,employme?i€ 
t«st?. 



o Is the handicapped student unable to work • 

.because phy si ced barriers • (e.g. , the lack, of 

ramps) eliminate available opportunities? Because 

the work station is upt. adjusted to meet her/his 

. handicap? . ' ' ^-^'^ 

I. , \ • , ^. ■' • 

o Is the limited, Eng^ish-spe'akinapergon unable to 
# - obtain a job because* she /hg^.<:annot complete a job 
; application or cannot ji^etlc as a member of a team 
because- of. ^onm^rd^c^ion difficulties? 

A major focus of th^se questions is on the obtaining and/or. 
retaining of a job. .Other questions^ may be raised regarding 
'^the quality of vocational preparatjLon. • 

/. jJust as the training needs are sometimes different for 
'those who comprise the special population, the data collec- 
tion needs and strategies "may also differ. For example, 
severely handicapped students may, not be able to. complete 
a mailed questionnaire. Economically disadvantaged pefs^s 
are often cbnsidered to be hard to locate. Therefore, ^ 
larger sai^ple size or an Unequal Probabilities of Selection 
(UPS)* procedure is needed to aid in obtaining reliable' and 
valid data. • .' ^ 

Thiis, it is evident that _ techniques or tasks of the • 
follow-up process as traditionally designed may need to 
be^^modified in order to collect the most useful cUid re- 
liable data on vocational education programs for special 
populations. Moreover, limited literature on vocational 
education follow- up studies of special po)^ulations and 
the. inOreasing demands by, local, state and federal 
aqencies for evaluation and accountability data in- 
dicate the need for increased follow-^up efforts. 
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Thls handboo)^..4f8nbased upon the existing literature 
relative tofs*x6w-up studies, evaluation, and special ' 
populatUettiT and Information obtained from individuals 
wg^-klng in the area of' special population evaluation.. 
'It is not designed- ta be the definitive dotument bn the . 
subject, but to ral^e questions, to Identify possible 
issues, and provide . guidelines and practices for improving 
the conduct of follow-up studies. By doing this we hope 
to facilitate the efforts. of state and local persons for 
improving the decisions, on 'vocatipnal Education for special 
populations. ' 

. 

The handbook complements Evaluation Handbook; Guide- 
lines and Practices for Follow-up Studies, Volume. Oni^ ?He 
ideas and concepts identified in Volume One are applicable 
to those follow-ilp tasks defined in this handbpok focusing 
on the special populations. 

The primary difference between Voluitte One and this 
volume is the .overall explication of the similarities euid 
differences in methods and procedures for 'designing, 
planning and conducting the follow-up study. The defini- 
tion of data analysis and use of follow-up information' 
and data is basically tlie same for both the special 
populations and the non-special .populat^ions — the determina- 
tion of efficiency, ef fejstiveness and relevancy of voca- 
tional education and the us^ of that information to 
support the decision -making process for vocational 
education program improvement. , 

* ^ 

, Further, this handbook is intended to assist state • 
education agency (SEA) and Iqcal education^ agency (LEA) 
persons who have an interest in or responsibilities for 
the evaluaticai of programs for special populations'. It 
is. not a step-by-step procedural manual? but it is a 
"ready reference" for identifying tasks, and best practices 
for accomplishing these required tasks. And it provides 
guidelines for assessing one's effectiveness in the 
evaluation process according' to adcepted practices. ; 
As suoh, it is important that the definition of follow- 
up as an integral part of the comprehensive evaluation 
be highlighted. Section II provides that detail. 
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Using^ the Handbook ^ ' f • ' 

Purpose d This handbook provides exemplary follow- 
up study ^rat^oies and procedures for, personnel in state , • 
and local eduoalioif Agencies, Moreover ^ a"* major objective 
is to assist those educational agencies in initiating and/or 
improving follpw-up system"^ or . studies of former Vocation.al 
students classified as special populations. ^ 

The handbook attempts to sypthesizev concepts, identify . 
best practices and materials from.the cickrent state of the . • 
art rather than add significamt new knowledge. ^In support iV " 
of this aim, ai^^attempt has been made to, systematically . j, 
survey the literature on 'follow-up,, evaluation and special 
populatioQs; intjerView. leading^ practitioners at the state 
and, local level; examine relevant laws and regulations? and 
tev,iew exemplary foLlow-up systems and instruments. The ' 
"effprt became one oi making rational order of the ejcisj^ing 
^literature ana follow<rup efforts and presenting the best 
'B^hni^ues, approaches, and coifiQpepts in one resource book. 

Audience . The target audience for this handbook is varied. 
Potential users include, but are not limited to, state and 
local vocational 9dmini9trators (at all levels) ,' policy makers 
for vocational programs, program funding agents, and state 
and local vocational program staff 'directly responsible for 
the operation of a follow-up system or* study. 

Naturally,' not all of the handbook's sections are equally 
important to each member of such a varied group of users. 
The educational policy makei/ has different needs from a 
program staf€ member responsible for the collection of 
evaluation or follow-up data. 

cMany users may be in need of information on how to 
improve an existing follow-up system. Thus, it is recommended 
that the initial task, of- the reader be to examine the° Table'*' 
of Contents and decide whitrh Section or Subsections are most 
relevant to her or his needs, or review and complete the 
"Checklist for Assessing Individual Problems" and the 
"Follow-up Study Profile" in this subsection. 

To the extent possible, each section of the handbook 
has bee^n written to provide readers with enough relevant 
in f^ormat ion about major concept's, alternative strategies 
and ^procedures, and substantive content .to make informed 
decisions on which step .or approach to perfoi^ next. Ad- 
ditionally, key references have been incorporated into the 
text to assist in this task. 



; ^QJ^j^nization. As»*a "ready reference", this handbqpk • 
IS divided into nine sections and many subsection^. 
Section 1; 2, and 3 provide- a background on ev^laution and, 
follow-up, and an overview of special- p^^lations highlight- 
ing d^f^initional issues and. defining the importance o^t 
evaluation and follow-up. Sections 4, 5, and 6 focus on 
the procedural steps requi^d in designing,, planning, /im- 
plemeriting and using follow-up studies. 

fi^ch sectipn in the handbook is self -cent ^ned. The 
reader can expect tb become f pillar wilbh the major concepts, 
alternative approaches (where applicable) , and techniques < 
associated with the^ topic of each sect^.on. A number -^^ 
se^ctions^make repeated references to legislativ6 'citations 
and state and , local pr ogr euimih tic concern Sf^. This- is 'dbne" 
with the> intent- of making each section s.elf-5ontained phased 
on the need^fot that type of information to support the 
particular cohttjnt of the section or subsfectiidn.. 'Also, • 
where appropriate., citations are made 'to Evaluation Harid- , 
books': Guideline's lemd Practices for Follow-up Studies, j 
Voltnne One ,? and information or textual material is taken froms I 
that document to support this volume'' focusing on special ► ' 
popul^itions. ' / , 

t^ithin each , section are major references or sources for / 
further infprm^atiof! . The s6'ctiohs are further divided by . 
subsections denoted with topical side headings. This - • . 
handbdok, as with Volume One , is not an instructional system 
with objectives, pretest learning materials, and posttests for' 
each section. Rather, the .major organizational' construct 
employed in the development of this docuirient was that it 
be a "ready reference" on the topic of follow-u^ of former 
vocational ^students classified as special populations* 

The "Checklist for Assessing Individual Problems" 
provides a means of identifying and prioritizing- follow- . 
up study problems. 




Checklist for Amassing Indrvidual Probtoms 



Do thosa^probtefnt 
exitt for you? 



Rank 



Order 



by Extant of 
Probhtm 



Yci 



No 



1 ; Lack of understanding of purpose 
for doing evaluation or follow-up. 

2. Lack of definition and conrfmunicatioh 
of objectives for conducting folloW-up 
studies. 

3. Lack of knowictdge of strategies and 
procedures for doing follow-up of . 
special populations. 

4* Lack of clear definitions essential^ 
for collecting reiidble and valid 
follow-up data. ^ ' 

5. Inability of people to use follow-up 
data in decision-making. 

.6. Unwillingness of people to use 
[ follow-up data for program planning, 
policy making, or evaluation. 

7. Lack of understanding^of federal, 
state or local education agency < 
follow-up data requirements. , 



/ 



a 
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• Follow-up study^^rof lie « Tfte handt^Pok Is organized 
airound the follow-up profile which appears on page four- 
teen, frhe profile presents the major, steps for designing, 
planniifc, conducting, and using .follow-up studie's by' \ 
highliwiting critical deciaions or input. It contains 
mfejor question? that )?ersons involved' in designings- 
planning, conducting , • and/or using fpltow-up sj^jaddses 
should ask. < 




The^ profile is designed to help you: 

o think tlirough the^ follow-up study process . 

» ^ 

o become, familiar with follow-up study issues that 
you might not have considered 

identify potential elements of^your fol^-ow-up 
study. plan that^need improvement 



o gain an overview of the contents of the ha^^ygok 

• . , » .. 4 ; 

o decide which sections of the handbook you should , • 
study in-depth.# read, carefully, or skim - 

' ' % » " ' 

The profile is simple to complete. In the left hand column 
rate your current knowledge about each of the question^ 
concerning follow-up studies.: . ^ » 



■sr 



. Current Knowlsdgo ' r ■ ■ , 



None f.^ ■ Partial . .Full 

1 ' 2 3 4 5 



Th© page numbers i-n'the right hand column refer to the 
section of the handbook which prpvides wore detailed 
information about each question.* An example appeggrs below. 



Current Ketdbiedgs 
None Pdiiiil , Pull 
.1 2 ,3 4 5 


* < 
t 


Page(8) 




.... . 1.- 


isstm. What are txjmmonaltties and 
difference b.etw^en follow-up studies 
for SDectal and tion-snecial vocational 
Students? ' 

' Legislative fiequfr^ments. What are the ° 
federal legistative mandates for follow-up 
of special populatiphs? ' 








51,52a, 


« • 


r . . 3. 

• m 

f 

— \ 


Instruments. What t\ pe(8) olfol low-up 
Instrunnents should be devebped, adopted 
; or adapted for special populations? 


, 76, 87, ' 
\ 171 



Follow-up Study Profite 



Current Knowled^ ^ 
None Partial ^ Full 

1 2-3 4 5 • < 



. 1. Definition. What is an acceptable definition 
\ of follow-up? 



V - 

2. Purpose. What are the local, state and federal 
follow-up study needs? 

3. evaluation Context. What is the importance 

of defining an evaluation context for follow-up? 

4. , Models. How can evaluation models support 
( the design of a follow-up study? 

5. Special Populations. What definition is used in 
vocational education? 

6. Legislation. What are the legislative fViandates 
for follow-up studies of special populations? 

7. Issues. What are the issues and problems in 
special populations follow-up? 

8. Follow fup Data Collection Methods. What 
methods should be used for fecial populations 
follow-up studies? 

9. Survey Considerations. What considerations 
must be made for special populations 
subgroups. 

10. Decisions and Steps. What are the major 
follow-up study decisions and steps. / 

1 1 . Objectives. What are the follow-up study 
objectives?. 

12. Qumions. What type(s) of questions should 
be included In a foMow-up study? 

13. Questionnaires. What are the characteristics 
of a good questionnaire? 



• 



Follow*up Study Profile — contlnuad 



Currtnt Knowledge 
'None -Partial Full 
1 2 3 4 5 



J. 



14. StBreotyping. How can se|^ and ethnic 
stereotyping be eliminated in foliow-up 
studies? 



91-92* 



15. Readability. How can one determine the 
appropriate readability level of the follow- 
up instrument? 

16. Reliability and Validity. How can one 
determine the reliability and validity of 
the follow-up instrument? 

J 

17. Sampling Procedures. What are appropriate 
sampling procedures and considerations? 

1 8. Management Information Systems (MIS). 
How is follow-up related to MIS? 

19. Data Use. What practical uses should be 
made of follow-up data? 



96-101 



101- 
105 



106- 

114 ^ 

131- 
132 

136- 
141 



ERIC 



^1 




/ 
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/ 

I 



/ 




SECT-ION 2 

EVALUATION AND FOLLOW-UP: ^ CONTEXT, 
^ , DEFINITIONS, MODELS AN^ RE'lATIONSHIPS 

This sectionr- focuses on a "discussion of evaluation. 
•The narrative higl|lights the J^ortance of defining an 
evaluation context, .identififcatlon of evaluation defia^-^ 
.tions,. and a brief presentations of evialuation models. Also, 
attention is given to* the relationship' between evaluation 
^nd follow-up. Specifically, f6i;Low-up is considered a 
subsystem of a comprehensive evaruation system. ' Follow-up 
studio are typically viewed as one form of) product evalua- 



tion; 



By providing this background information on evaluation 
and ,follov-up, ^ logical basis can be defined fot iappropriate 
follow-up procedures and techniques. 

Vocatioral Education and Special Populations 

Prevocational and vocational training pf the Special 
populations has become^a matt^ef of increaging concern to 
vocational educators ih rtecen-t years 4 Moreover, the federal 
legislation and a focus on humanitarian princijples has 
created interest among many groups. Teachers.^- parents, 

•students, administrators, legislators, empitSyers, and the 
general public have, shownNan increasing- 6oncern toward 

■improving the educational \i>pportunities and labor market t 
experiences qf those individuals defined as special popula- \ 
tions. These' special populations as defined in the Education) 
Amendments of 1976 include: {I) women, (2) -members of mino^it 
groups, (3) han^dicapped persons, (4) disadvantaged person^ 
and (5)- .persons of limited English-speaking ability. It 
should ^e noted that this listing of special populations is ^ 
not all inclusive. There are individuals and educational 

^agencies who include other subpopulations, such as the gifted 

"and ex-offenders in their special populations' definition, ^ 

Interest and efforts, in varying degrees of success 
^nd intensity, have been directed itowar^ the many and varied 
^>roblems a-^sociated with meeting the needs of the special 
populations. Problems include the inaccessibility of voca- . 
tional curricula and- physical facilities, inadequaciekan 
the development of appropriate and adequate work expei^ence 

• -17- ' ^ . 
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programs, uncertainty about the age at which to admit ^ 
student's to a preyocational ot vocational pfogrcuny inadequate 
career counseling and job placement services, insufficient 
methods for evaluating work potential and adaptability, ^ 
and absence of valid follow- through and followrusL, procedures. 

/ • V C 

The challenge for vocational educators is^to overcome 
the attitudinal, programmatic, and Physical facility barlriers . 
that exist, and in so doing, to develop a hew lev&l of 
awareness regarding the critical need to . facilitate the 
special populations* participation in ° the total educational 
system. Obviously, the requirement for comprehensive 
evaluation of; existing program efforts to assist in meeting 
the needs of the special populations is paramount. ^ 

As the vocational educator is exposed to public media 
and reads professional literature regarding the evaluation 
of vocational programs for specific populations, she or 
he finds questions such as: > - 



> 



1. What is vocational education for special ' 
populations? 

• 

2. . What evaluation methods and models are appropriate 

for special populations? 

i 

3. Against what standards* should programs for special 
populations be evaluated? r 

4. How can one evaluate the riilative merits of several 
components of a course or/curriculunF designed for 
special popula,tions?|' 

5. What^ata and informstt±6n from an evaluation or* 
follow-up 'should beused to assess the effective- 
ness of ■ course crfferings for special populations? 



One of the controversies in education today relates 
to. the purposes of evaluation and the proper uses- to which 
it should be put. Parallel to this 'general concern •' s the 
overriding issue of the priority assigned to evaluation 
within vocational education, and, more specifically, the 
definition of an ev^aluation Context for the vocational 
education programs serving special populations to support 
the follow-up phase pf evaluation. 
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' An E valuation Context 

* • 

. Context is defined as "the payt or parts of a written 
or spoken passage preceding or following a particular 
word or group of words and so intimately associated witjh 
them as to throw' light upon their meaning^''^ 

The general context of vocational education evaluation 
and follow-up studies in particular is defined through 
(vl) a definition of the purpose of the vocational program, 
(2) the objectives and activities related to and necessary 
for achieving the purpose, (3) and organizational factors 
involved in the administration and management of those 
activities. 

Evaluation has taken op added signif^icanceSwith the 
passage of the Education Amendments ' of 1976. The pre- 
scriptive nature of the 1976 Act— i.e., requiring the 
evaluation of .all vocational pr-ograma within a five-year 
period has cause<|, concern*^ among many vocational educators. 
Questions of financial and personnel resources to perform 
or^complish effective and efficient evaluation, along 
with the question, ^ "When is it mos^ appropriate to do 
evaluation?" have surfaced as major concerns. Also, the 
problems of th*e 'lack of -comprehensiveness and the non- 
systematic approach to evaluation ^continue to plague the 
vocational education community. * There have been several 
reasons for this lack of attention: 

t 

1. Evaluation receives lower priority than other/ 
activities. ' . ' -C . , ' 

.2. Evaluation is t'hreating to>many' educators. 



r 
f 



3. Evaluation receives minimal financial support. 

4. Wogram developers do not consider evaluation 
as one of their responsibilities,- 

5. Program developers often are nojt adequately ^ 
prepared to conduct evaluations^ ^ 



*Sce the Federal' Regulations, October 7, 1976: Sections 
104.401 through 104.405 and the requirements for the pre 
paration of the accountability report, Section 104.241. 



J 

Further delineations of the problems which have 
contributed to the vocational educators ' marginal en- 
thusiasm for comprehensive evaluatibn, were highlighted in 
a National Seminar on Research in Evaluation of OccAipational 
Educat?.on at North Carolina State University. 

'1. The goals and objectives of vocational education 

have not been succinctly stated or clearly defined. 

» 

2. There are few valid an^ reliable instrum^ts for 
assessing behavioral change. 

3. The outcomes of vocational .education are diverse 
cJid difficult to measure. 

4. Evaluation results frequently are not used as 
^ information by " management. 8 

Wall highlights a negative' perception of some individuals 
and .offers a positive view for vocational educators re- 
sponsible for special populations; program operation^: ' 

"In too many instances, evaluation has been miscon- 
strued as a final judgmental process.. Such a view creates 
tremendous resistance on the part cit project personnel 
who operate programs for disadvantfted and handicapped 
persons, Evaluational efforts always should be directed 
toward measurements that will kid in diagnosis as well 
as clarify and improve program direction. "9 

• 

However, the. federal, state and local requirements demand 
greater evidence of accountability for tax dollars spent on 
education, and this has led^ to a greater concern and need for 
evaluation in a comprehensive and systematic mamner. This 
concern gained momentum in the early-1970 ' s , and reached 
a high point in voca^onal education with the passage of 
the Education Amendments of 1976. 

Moreover, the concern was not limited to vocational 
education; it appeared that all social science areas were 
experiencing a sudden interest in evaluation. Flaherty 
and Morell identified four causes of this sudden SDurt 
in the growth of evaluation: 

1. Greater requirements for accountability in publicly 
funded programs , . j 

2, Increasing interest amon^ social scientists in 
social relevance, 



] 



3. A decrease in financial resources for the 
traditional social sciences, and 

4. An expansion in the social science methodologies, 
\ apprppriate for research in applied settings. ° 

Factors affecting an evaluation definition * An in^- 
dividual' s job responsibilities may have a major influence 
on one*3\defin^ition o^ evaluation, ■ The local or state ad- 
ministrator, the curriculum or^ program specialist, the 
pupil personnel director, the teScher^ the .parent, advisory 
council mender ^ and state board of education member may 
all perceivte .fyaluation within and based upon their in- ^ 
dividual roles and functions. ; 

For one pWson, evaluation nfiay have a negative connota- 
tion — a proces^ which identifies what is wrong anfi who is doing 
it — a personal \indi%^ent. For anpther, it may -have a 
positive connotation wnich ban be dfefined. as a process 
which improves pVoqram efforts or individual perform- 
ance.-'^^ \ 

One would suspect that for .obs which involve critic^ 
tasks, like major oecision-making, evaluation would be j 
defined in the positave sense — a process which assists / 
in improving existing conditions Imd butcc^mes. Howevery*^ 
there is little evidence to support this hypothesis.^-^here 
are many other possible variable^ affecting one's perspective 
in defining evaluation. Common themes or ideas do, however, 
appear in most definitions. 

Evaluation; a definition or defii^itiofis ? The word 
evaluation has many definitions. • Good off^s the following: 

\" 

1. The process of ascertaining or judging the value 
or amount of something by use of a standard or 

. appraisal; includes judgment's in. terms of internal 
eviden,ce and externai^criteria; 

2. The process of determining the relative significance 
of phenomena of the same sort in ternws of some 
standard (psych) ; „ 

3. The consideration , of evidence in the light of 
value standards and in terms of the paiticular 
situation and the goals which the group of 
individuals is striving to attain; 
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* 4. A judgment of merit, sometimes based solely on 

; measi^ments, such as those provided by test ' » 

scoreiV but more frequently involving the | 
syntnesis of various measurements, critical ir|cidents, 
.sut^jective impressions, and other kinds of evidence >■ 
\ y?eighed in the process of carefully appraising 
sthfi ef^cts of an educational experi)?nce.^2 

/ ' 

, Evaluation may be viewed as a process which supports 
decision making. Stuff lebeam, et al. identify this trend, ^ 
defining evaluation as "the process of ttelineating, • ' 

obtaining, and providina usef-ul ijifprmation for judging 
deqision alternative^. "^^ ( ^ I 

\ . ^ *• • 

Evaluation is also considered to be an ev^ving a 
field. Although many view evaluation as some^lng xinique 
and separate, others see it as no more than a- mx^ture of 
concepts and' techniques from 'different fields, qualified 
because there 'are a few .concepts and techniques which seem 
to have been created specifically for the ne^eds of evalua- 
tion.^^ According to Struenrnf", "the field of evaluation 
has not produced a well developed applied science complet§ 
with a comprehensive set of constructs and their reliable 
and valid measures. Nor has i^ deve.loped a' systemajllcally 
acquired body of knowledge acceptable t<^ the scien£ific ^ 
community and suf f iciently ^gpner^^^l . to apply in a Variety j 
of settings without question, "^^ - 

\ 

"■vocational education evaluation, as a resii^^t of^^he 
passage of the 1976 Act, has received added attention. 
The prescriptive nature of the Act in vs^ious sections 
outlines evaluation mandates for vocational educatbrs. 
The state and local education agencies and theit various 
advisory committees or councils .are given well-defined 
evaluation tasks and responsibilities. 



To summarize the criteria used in defining those 
evaluation responsibilities,.' it could be stated that 
vocational educators are required to determine program 
quality based on three criteria — ef fiectiveness , efficiency, 
and relevancy. These criteria are essential not only to 
the evaluation of vocational education for non-special 
populations, but also for special populations. ^ 



J 

The specific mandates from the ^ucation Amendments 
of 1976 in regard to tife evaluation activities by the sjtate 
board^ (Section 112 (b) '(1) , 20 U. S. C. 2312) require 
that during the fivej-year period of the State Plari-the 
state board evaluate in Quantitative terwa the effective- 
ness of each fonimlly organized program or project supported 
by federal, state, and local funds. These evalyaltions 
should be. in ter^is of: , . * 

"(a) Planning and operatioi^ processes,^ such as: 

* t - » 

(1) quality and availability of instructional 
offerings; » 



(2) guidance, counseling, and placement and . 
follow-up services; 5 

(3) capacity, and condition of facilities and 
equipment; 

(4) employed participation in cooperative programs 
of vocational education; 

•J (5) teacheV/pupil ratios; and 

(6) teacher qualifications. 

(b) Result^ of student achievement as measured, 
roir example, by: 

(1) standard occupational proficiency measures; 

(2) criterion referenced t^sts; _and 

(3) other e'xamih^ionS of ^students' skills", ' 
knowledge, attitudes, and readiness for 
entering emplbym^t successfully, ' \ . 

(c) ' Results of student .emplgyi^ent suqcess as measured, 

for example, by: 

(1) rates of employment unemp'lt>yment ; 

(2) wage, vrates; 

(3) duration of employment; and 



i 



(4) employer satisfaction with performances o^ 
vocational education students as compared 
with performance of persons who have not 
had vocational education." 
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In' summary, the evaluation context requires defini- 
tion and 'undeyatanding by those persons responsible for 
or users of vocational education evaluation data and 
information. It is ^important/that these individuals • 
recognize . this general context of vocational education 
evaluation and in particular follow-up studies as 
defined through (ly a defini^tion of the purppse of the 
vocational program — federal, state, local definitions, 
(2) the activities related to Ind necessary for achieving, 
the administration and, management of these necessary 
activities. From this understanding and definition of the 
evaluation cbntext, one can identify and/or adapt an 
evaljaation model. ' Although many models exist there is 
a representative sample which have been more widely used 
than others. The following subsection identifies the 
selected models considered appropriate for designing, plan- 
ning and conducting follow-up studies. 

Evaluation Models 

The following narrative attempts to offer the reader 
a brief description of the definitions and purposes of 
certain- evaluation models. The ififormatipn was obtained 
from a number of sources to which the reader is referred 
for further^- definition and information. ' 

, • 

' This section is intended, to pr9vide the reader with a 
logical basis for identifying* an evaluation model which" may 
assist her/him in defining appropriate evaluation or^ 
follow-up procedures and techniques. 

■ f 

Behavioral objectives' rtiQdels , Ralphi Tyler designed . 
this approach which is sometimes referred to as the Goal- 
Attainment |Iodel (GAM). Thi.s^o^del' is described as a 
curriculuih evaluation, mod^ oft ly. Although widely used, 
it is not a total ptogram .evaluation model. The process 
involves: ^,.( 11' analyzing objectives (i.e., behaviorally' 
stated Ob jectives) to identify and clarify- them, (2) identi- 
fying situations that will give the student a chance to 
express the behavior related to the content, (3) developing 
instruments that will record (measured by norm- referenced . 
or Oriterion-referenced tests) the behavioral* (4) fmaiyzing 
the amount of change /that occurs, and. ^5) a^J^lyzine^ the 
program in terms of its effectiveness in helping students • . 
achieve th^ir objectives. 

Another model laider this classification is thfe 
Discrepancy Model. This model was designed by Malcolm 
Provus and evaluates the comparison of perfoxmance with 
standards. Specifically, the process evaluates by: 
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(X) defining program staindardsj (2) determining whether a 
difcr^pancy exists between an aspect of prbgrapi and the 
actual performafnce based on standards for that aap«rtt nf th^ 
prograiB, and (3) use of the discrepancy information to change 
performance or program standards* The model . consists of four 
stages — design, installation, pr'ocess, and product. 

• ' 

Goal ^ree Evaluation (GFE) . in contraEit to goal based 
evaluation where the evaluator, is concerned with the quality 
of an educational program's goals and thq extent to which 
those goals are achieved, QFE focuses on. the outcomes of a 
program© (both' intended and unintended) . The- GFE process 
starts without referring to the goals or objectives of a . *■ 
program. The basis for determining which data to collect is 
the need(s) for which the program were designe'd. Actual 
effects are .then . compared with these needs rather than with 
the- program' goals.' Michael Scriyen, the originator of GFE, 
has not recommended GFE as a replacement for behavioral^ 
objectives evaluation, but as a cbmpleirent. ' Ideally, both 
behavioral objectives evaluators ahd GFE evaluators would 

be used in the evaluation design". 

»• ■ • • , » 

Decision Making . The Context, Inout, Trocess, and Product 
(CIPP) Model introduced by Daniel Stufflebeam and Egon 
Cuba represents four types of evaluation— Context, Input, 
Process, and Product. The model is based, upon the premise 
that evaluation activities are performed in order to aid 
decision -making. Thus 4 the four types of evaluation • 
correspond to 'four ^na'jor types of decisions-'-plannihg, 
structuring, implementing, and recycling. ■ These rela- 
tionships are gi^en below. [ 



t 

Ctecision 


• ■ ' t • 

Evaluation 


r 


Planning (to 
determine objectives) 

W ' 


Context (needs 
assessment) 




Structuring (to 
design proceduEes) 


Input (program design) 




Implementing (to utilize 
and refine procedures) 

) 


Process] (feedback, 
monitorfing) 

Product (summative- 
type evaluation) 




''Recycling (to judge and ' 
react to attainments) 






The Center for Study of EvaluAtjion CCfiE)» Model, developed 
by flarvin Alkin, is similar to the CI PP Model in that it . 
also strives to use evaluation 'as ai> aid in decision-making. 
The major "difference Is a sjibstantial reconceptuallzation 
of "pjrocess evaluation" in the, CIPP Model. Whereas the . 
CIPP ev^ilu^itors, focused on procedural* considerations 
during process evaluation, the CSE Model encourages the 
evaluator to look at products, designed at tha^ Vo^t in 
addition, to processes.' Thus,^ the , CSE Model' consists of 
the following steps: • (1) needs? assessment, (2) program 
planning, (3) implementation Revaluation , (4) program . evalua- 
tion^ and (5) Qutcome evaluation. ^ . ' 

To provide a- sample of models aj^d. a classification 
scheme, a number" of "sources w^re reviewed. A recent 
classification scheme of fered by -House* includes eight 
major evaluation models: systems analysis ,. behavioral 
objectives, decision .making, goal free» criticism, 
accreditation, adversary, apd' transaction'. Steele, :in 
definj.nq evaluation methods for programs in disadvantaged 
adults, identified over fifty models.** They are summarized 
in Figure 2-1. For additional inform^tionV the reader is 
encouraged to review the following sou'-cesi 

• ♦ 

Primary Sources: 

Tyler, Ralph W. Basic Principles (^f Curriculum , 
and Instruction . (Chicago: University of Chicago 
Press, 195CJ) . a 

• . Scriven, Michael.. "Pros and Gons about Goal Free 

Evaluation," ' Evaluation Comment , 3, No. 4^ 
(December, 1972) , pp. 1-4. 



*The reader la referred to the article* by Ernest R, House, 
"Assumptions Underlying* Evaluation Models," Educational 
Researcher , Vol. 7, No.. 3, March 1,^78,' pp. 4-12. 

**Sara M. Steele has identified fifty models for evaluation. 
The term model is used in the broadest sense. She states ^ 
that these models ,. approaches or frameworks, are adopted 
from processes that were -used; others are designed as general 
ways of conceptualizing evaluation. She ^dds that few of the 
authors would consider" their materials "models" in either , 
the theoretical or the "ideal" sense, yet all provide ideaa 
to the programmer in help.ing her^or him set evaluation 
strategy. 
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An Ov^isw of SelseSid Evaluation Models* 

r 



^hdvioral 



Goal 

Attainment 



Oifcrepancv 
Evaluation 



Designer 



Ralph W. 
Tyler 



Malcolm 
Provus 



Summary 



Evaluation h concerned with 
determining whether education 
is actuaHy > roducing the results 
that iv^s out to ^nhieve as 
indicfated by statements of 
objective. . 



Standards are set for proper 
performance. Actual performance 
is compared with the standards 
and discrepancies or areas for 
improvement identified. 



Use 



The model can be used In any 
program that has objectives. How- 
ever, it usually is most sucosssful 
when there is evidence th^ the 
objectives are realistic and ti«e 
prograni input great enough to make 
it logical to expect results. 

T 

The modet is particularly useful 
in checking out pilot or new 
programs, diagnosing problems 
with programs that are not 
functioning well, and improving 
program efficiency. 



Goal Free 



Goal Free 
Evaluation 



Michael 
Scriven 



Program results are judged , 
against the originating need. 



The model is helpful in situations 
where objectives are not clear or are 
are unrealistic. It is also helpful as a 
means of examining objectives to 
assess the potential (determine limita* 
tions) of the program. It comple- 
ments the goat based evaluation. 
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Figura 2^1 - 



Model •* 



Decision 
Making 

Context, 
Input, 
Product 



Center for 
Study o^f 
Evaluation 



Designer 



Daniel 
Stuff lebeam 



Marvin ! 
Alkin 



Summary 



four types of evaluation-context, 
input, process and product 
corre^3ond to four kinds.of 
decisions-planning, structuring, 
implementing, and recycling. 

Five evaluation stages are suggested 
which will aid decision md(in||. 



Use ^ 



\ 

The model can be used through the 
program process. 



The model can be ussd through the 
program process. 



T 



•Adapted from: Steele. Sara M. Contemporary Approschm to Program Evaluation, Syracuse, New York- €RIC 
■ Clearinghouse on Adult Education, no date. ' ■ 



Classification of models adapted in part from House. Ernest R. ' Assumptions Underlying Evaluation Models "' 
tducational Researcher, Vol. 7. No. 3, March 1978, pp. 4-12. 
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f • Stufflebeam, Daniel L. , et al. Educational Evalua- ^ 

tion and Decision Making ( Itasca, Illinois: 
F. E.. Peaqock Publishers, Inc. , 1971) , 

Alkin, Marvin C. "Evaluation in Theory Develop- 
ment," Evaluation (Berkeley, California: McCutchan 
Publishing Co. , 1971) . 

Suminary Sources: 



Popha.n, W. James. Educational Evaluation 
(Princeton, New Jersey: Prentice Hall, Inc., 1975). 

Steele, Sara M. Contemporary Approaches to Program 
Evaluation ( Syracuse, New York: ERIC, Clearing- 
house on Adult Education, May 1973). ' ' ^ 

* 

Worthen, Blaine R. and Sanders, James R. . Educational 
Evaluation: Theory and Practice (Worthington , 
Ohio: Charles A. Jones Publishing Company, 1973) . 



Summary . 



The multiple concerns for satisfying the needs of the 
soecial populations has dramatically increased since the 
landmark 196 3 vocational education legislation. The mood 
of society has shown a more humanitarian interest and a 
broader perspective of the problems. The recognition of 
special populations which have expanded in definition to 
include not only the disadvantaged and handicapped, but 
also minorities, women'^tand limited English -speaking, -has 
brought about increased efforts to develop viable programs 
to address those problems which deny equa^ opportunities 
for those individuals . in the labor market. 

These problems include the accessibility of vocational 
curricula and physxcal..'f acilities , inadequacies in the 
development 9f appropriate and adequate work experience 
programs, uncertainty about the age at which to admit 
students to a prevocational or vocational program, 
inadequate career counseling and job j^lacement services, 
insufficient methods for evaluating work potential and 
adaptability, and absence of valid follow-through and 
follow-up procedures. ^ 

Certainly the need for comDrehensive evaluation of 
oxistincT efforts to meet the ne'eds of the special popula- ^ 
tions is paramount especially in the federal legislation. 
Howovpr, the definition problems surroundina evaluation 



( 



the methodological constraihts in conducting ef- 
fective evaluation continue to exist. But this ^hould not 

^preclude those responsible for meeting the prografnmatic 
needs of the speokal populations from establishing and/or • 
developing comprehensive evaluation systems. Even though 
the evaluation fields is considered to be in an evolving 
t;taye, strategies, procedures and methods proven to .obtain 
results exis-£, which can iflefet existing evaluation needs. 
Conducting a follow-up study—is one" phase of a comprehensive' 

•evaluation system which can serve the need. 
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OVERVIEW OF SPECIAL 
POPULATIONS 




\ SECTION 3 

OVERVIEW OP SPECIAL POPULATIONS 

I 

o 

The overview is, intended to define the special popula- 
tions primarily within the context of past and pres.ept 
lecrialatLen, and" vocational programmatic efforts responsive 
to tliat/iegislaticn. 

Each special population will be dis^us^ed in turn. 
The format for these" sections is: definition, legislation, 
and existing vocational" education programs' for special 
populations. " t 

Throughout this handbook, special populations are 
identified as those requiring modifie4 programs and support 
services to succeed .fn regular vocational education programs. 
Beyond the fi|.nctional element of this commonly accepted 
definition, fhere appears to be very little uniformity 
or consistency in legislative and regulatory definitions 
of these j^opulations. 

f The Education Amendments of 1976 designate five special 
populations J disadvantaged, handicapped, * limited English- 
speaking, ininoriti,es, and women. Yet a cursory review of the 
education literature reveals a plethora of terms used to' h 
label and classify special populations. It is interesting 
to note, furthermore, that while the gifted or talented * \ 
are presentiy not included in the federal definition of . " ^ 
special populations, twenty-one states have legislation which 
includes this group within their def ini'Clon of %<§pecial - 
populations. 16 

In light of federal reportina requirements for follow- 
up studies of vocational education programs f . r special 
populations, the need for a common base of definitions 
(which could feasibly be attached to local labels) is 
critical. The overview in this section is intended to 
identify four of the special populations, p'Timarily in 
accord with recent legislation, and to feature certain 
vocational education program efforts responsive to that 
leoislation. ^ 



.piagdvarftaged and Minorities 



The 'disadvantaged population is highly representative 
• ot* ethnig/racial minorities and white populations at the \ ' 

povertfj^ income, level. Commori'ly accepted definitions identify 
with etnnic/rap^ial minorities from the following subpopulationss 



o Black Americans 

v. . 

o Hispanics 

Mexican Americans 
•Puerto Ricans 
Cubans 

.Latin Americans 

o /American Indians 

Including Alaskan Natives or Aleuts 
Hawaiians 

o Appalachian Whites 

*o Asian Americans . ^ ' «, ' 

* 

< The disadvantaged can be characterized by some combina- 
tion of : • • . . , <• 

1. Concentration in central city slums or rural 
depressed areas; 

2. Low family incomes and low' ediigational attainment 
^ ' of parents,; 

i. Unfamiliarity by personal experience or role models 
with the v^ues a^ customs of the world of work; 



) 



4. Disillusionment and frustration with and rejec- 
tion of or by the existing school system; *' 

5. Restricted time horizons and limited ambitions -x 
imposed by unfamiliarity with, the world's oppprtu^ 
nities and a conditional disbelief in its promise; 

6. Over-representation among minority youth. 



Disadvantaged and minorities and legislative action . 
uuth federal and state governments have been increasingly 
iware of the welfare needs of the disadvantaged. Their 
passaqe of legislation has given higher priority to 



initiating, among other educational efforts, special voca- 
tional programs and services for persons with academic, 
ocio-economic, cultural, or other handicaps that prevent 
hem^frpm entering and progressing in the labor market. 

Whe Vocational Education Amendments of 1968 defined ' 
disadvantaged as: 

. persons who have academic, socio-economic, 
cultural, or other handicaps that prevent them 
ttom succeeding ^in vocational education ot 
consumer and homemaking programs designed for 
, persons without such handicaps, and who for that 
reason require specially designed educational 
programs or related services. The term includes 
• persons' whose needs for such programs services^ 
result from poverty, neglect, delinquency, or 
cultural or linguistic isolation from the com- 
munity. at large, but does^ not include physical-ly 
or mentally handicapped per so'ns, unless such 
persons alsb puffer from the handicaps described 
in -this paragraph. 

More recently, the Education .Amendments of 1976 
define disadvantaged as: 

persons (other than handicafcjped persons) 
• ■ who halve, academic or economic handicaps and 
who require special ..services and assistance 
in order to enable them to succeed in vocational 
education programs* under criteria develB^d by 
the Commissioner based on objective standards 
•and the' most* recent available data. 

Disadvantaged and vocational education . The following 
information jTresehts a brief status review of the dis- 
advantaged in vocational education based on findings of The 
National Center. for Research in Vocational Education for 
the school year 1975-76.,, Enrollments reported for dis- 
advantaged students increased to 1,873,304 (5.2 percent). 
As a result, disadvantaged repres<2nted a slightly larger 
percentage of total enrollment. These figures do not 
reflect those mainstreame'd without services provided from 
specially designated fuTids over the years. The reported 
percentage of total vocational funds spent on disadvantaged 
has remained very stable over the years. Since the records 
do not include mainstrearaed students, it seems likely that 
vocational educators are allocating and reporting their 
exper\ditures for'' special classes and services to assure *they 
have met the legislative requirements. Once they have 



satisfied these requirejnents, they doXriot attempt- to report 
other services for the disadvantaged laeing provided 
from regular funding in regular classeis. Methods are needed 
to determine the extent to which these iservices as well 
as special ^populations services are beiiw provided. 18 

• \ ' 

Handicapped \ 

A handicapped person is one who has a physical or mental 
impairment. Categorical definitions of handicapped persons 
identified in the Educational Amendments of 1976 include: 

o Mentally retarded • 

o Hard of hearing 

p Deaf 

o Speech impaired 
o Visually handicapped 
o , Seriously emotionally disturbed 
o^ Orthopedically impaired 
• o ♦ Other health impaired 
o Deaf-blind 
o* Multi-handicapped 
o Specific learning disability* 

Handicapped and legislative action . A major break- 
through in legisla^tion designed to aid the handicapped 
came in 196 3 with the Mental Retardation Facilities and 
Community Mental Health Centers Construction Act. The 
Elementary and Secondary Education Act of 1965, although 
not designed specifically for the handicapped, provided 
massive funding for the education of the handicapped. 
•In 1966, Title VI was added %o the Elementary and Secondary 
Education Act making it explicit that states take re- 
sponsibil^y for initiation, expansion, and improvement of 
programs for handicapped children. In 1968, three acts 



*See Section 7, Glossary, for further explanation of these 
terms , 
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were passed by Congress having impact on the education of 
the handicapped: P.L.- 90-480 sought to eliminate archi- 
tectural barriers to the physically handicapped; the 
Handicapped Children's Early Education Assistance Act 
was targeted to preschool children? and ,the 1968 Amendments 
to^the Vocational Education Act provided that ten percent 
of allotments to states must be used for the handicapped. 
The Rehabilitation Act of 1973 is similar in intent and 
language to the Civil Rights Act. of 1964 and Title IX of 
the Education 'Amendments of 1972.' . While the latter bar 
race )and sex discrimination "respectively, -the Rehabilitation 
*Act bars discrimination against the handicapped individual 
in all progr^s which receive federal aid. The Education 
of the Handicapped Amendments of 1974 (P.L. 93-380) 
increased federal funding for' education of the handicapped 
and introduced the concept of mainstreaming. The Education 
for All Handicapped Children Act" of 1975 (P.L. 94-142) • 
expanded "upon P.L. 93-380 and mandated stricter compliance. 
These major pieces of legislation are suinmarized in 
Table. 3-1. ' 

Handicapped and vocational education . A report on 
Project Baseline, which was based upon a twelve state survey 
for the 1974-75 school year, notes that handicapped students 
comprised 1.66 percent of the total enrollments in voca- 
tional education. Of those served, 75.4 percent were at 
the Secondary level, 12.4 percent at the adult level, and 
12.3 percent at the postsecondary level. Handicapped 
students appeared to be concentrated in occupational home 
economic (7.18 percent), distributive education . (2 . 65 
percent), trade and industry (1.68 percent), and consumer 
and homemaking programs (1.55 percent). The report 
notes that without knowing the particular programs in these 
areas in which most handicapped students are enrolled, it is 
reasonable to suspect they are headed for low or non- 
salaried careers. It W^s also reported that th&xe was no 
evidence of any increase in the proportionate numbers of * 
nandi capped students receiving vocational education. The 
actual numbers served were relatively small, but the handi- 
capped as a percentaoe of the^ total vocatio'nal education 
enrollment continued to ao down. Thus, "enrollment data 
. . . shows that the primary beneficiaries of vocational' 
education have been middle class, academically average 
students. By comparison, ... the handicapped have been 
areatly underrepresen ted in vocational education. "19 

The Vocational Education subpart of the Education 
Amendments of iTfe fequi^es states to meet the fallowinq 
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Table 3-1 

Legislative Actions Affecting the Education of the Handicapped 



iaJation 



Mental Retardation 
Facilities and Com- 
munity Mental 
Health Centers 
Construction Act 
(1963) 



Reh^ilitation 
Act of 1973 



Education of the 
Handicapped 
Amendments of 
1974 



Education ior 
All Handicapped 
Children Act of 
197S 



Coverage 



Provisions 



Aoencv 

Administering 
the Action 



1 Amended prior 
legislation to, 
train professional 
personnel in all 
re«Hpiized 
categories of 
handicap. 

2) Funding for 
R&D projects 
in all categories 
of handicap. 



HEW 



All programs 
which receive 
federal aid 

Bans discrimina- 
tion against the 
handicapped. 



HEW (Office for 
Civil Rights) 



• "Bill of Rights 
for the Handi- 
capped." 

• Introduced the 
philpsophy of 
malnstreaming. . 

• Clarified a child's 
right to free public 
education regard- 
less of the severity 
of handicap. 

• Increased federal 
finding. 



USOE, HEW 



r 



All programs 
receh^ir^ funds 
under the Act 

• Mamiates publicly 
supported education 
for all handicapped 
(between the ages of 
three and eighteen 
by 1978 and three 
md twenty-one by 

• 1980). 

• Requlm school 
officials to dewlop 
«i individualized 
oJucation program 
for every hendi- 
canned diiid. 

BEH, USOE, HEW 



9 



4 



o Give assurances that federal vocational set aside 
monies for the handiqapped will be used" in- a manner 
^consistent with the go^ls of P.L. 94-142. The state 
plan fqr V9e:ati0nal education must bfe consistent 
with the state plan for education of* the handicapped. 

to • 

o Give assurances that the. handicapped have equal 

access to the programs and services available to the 
.n on -handicapped. ' 

o Describe programs and services to be provided for 

the handicapped and match these federal monies on I 
a 50/50 basis. 

o Insure representation of the handicapped' on ■ national 
a;, state vocational advisory councils for vocational 
education .20 . 

Some states have developed alternative strategies for 
providing vocational education services- to the handicapped. 
For example, in Michigan, state leaders in special^duca- 
t^.on and vocational educatioi;i. have cooperatively developed 
several progriun options for serving the liandicapped. The 
alternatives developed appear in Table 3-2.^1 



Limited English-speaking and Bilingual 



This designation applies to any .member of a national 
origin minority whq, does not speak and understand the , 
English language in an instructional setting well enough to 
benefijt from vocational studies to the same extent as a 
student whose primary language is English. Some examples 
of: national origin minorities are Mexican, Portugese, 
Vietnamese, Chinese, and Puej^to Ricah. 

Li mited English-speaking and legislative action . The 
massive educational reform triggered by the Elementary and 
Secondary Education Act of 1965 was the first systematic 
effort to identify and treat- the ecucational'' deficiencies 
of students with problems stemming from inadequate control 
' of the Enalish language. 'Phe earliest such' efforts were 
typically labeled ESL or English as a Second Language. 22 

Theso early components of Title I were soon augmented 
by more comprehensive thrusts of federal funding under 
the 1967 amendments to P.L. 89-10 which created Title VII,- 
the Bilingual Education Prooram. Under this program, the 
concept of instructional intervention was enlarged from- the 
ESL focus to a multi-component proqram including staff 
development, community involvement, ajnd development of 
instructional materials. 23 
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Vocational AltomativesAvailabto 
for th« Nandieappsd in Michigan 



Type of 
Program 



Description 



Regular > 
Education 



Adapted 

Vocational 

Education 



Regular voca^ona) education or general high school programs 
are used for all handipafiped kudents who can benefit from 
placement. All stumnts receiving non-instructional special 
education s»rv.ices (meech, social work, occupational therapy, 
special materials li)c4|alking books, etc.) are placed in these 
programs. . 1 ^ 

Regular vocational -0n^rams are altered to accommodate 
eligible special education students who dould not otherwise be 
placed m the program. S^ial materials and instructional aids 
are examl)les of adapting the program. This alternative may be 
needed for handicapped persons assigned to teacher consultants 
or special education. r^scFurce rooms who need adapted instruc- 
tion. • ' . 



Special 

Vocational 

Education 



Individual 

Vocational 

Training 



Training is ^usually of fa semi-skilled nature (such as' custodial 
training, nurses' aides) or introductory skills training (elec- 
tronics, autb mechanics, secretarial) designed to provide pre- 
requisite skills for entry into a regular vocational education 
sequence or to provide entry level job skills, it is designed for 
handicapped persons whose disability precludes intonation 
into a regular voeational education progrann. It is usually 
limited to handicapped students assigned to self-contained 
special education programs. 

^Training in special programs (such as MDTA, apprenticeship, 
training) approvec by a governmental agency, or a unique 
individual training program (such as outboard motor repair, 
tailoring, inhalation therapy) designed to fit a handicappeci 
student's special interests and not generally available in the 
geographic area. This program may be used for any special 
training needs. Community training stations m^jy ,be used so 
long as students do not become employees and are not paid 
a wage. ' . j .■ 
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Tabte 3*2, continued 



Type of 
Program 



Prevocational 

Evatuatton 

Services 



Work 
Activity 
Center 
Services 

Work Study Services 
for Students Who 
Have Not had 
Vocational Education 



Description 



Designed for students whose disability precludes the use of the 
regular education sequence for obtaining vocational assessment. 
The service is provided in a sheltered workshop authorized by the 
U.S. Department of Labor to provide this service. Plawment \i 
limited to six months by U.S. Department of Labor rules. This is 
diagnostic service and not an instructional program. 

Designed exclusively to provide work therapy for impaired persons 
whose handicaps are so severe as to make their productivity capacity 
inconsequential. The program mufX be licensed as a sheltered 
workshop by the U.S. Department of Labor. 

Available to any special education student who is within one year of 
termination due to age, or who has notified the school of plans to 
drop out. Students must be employed and paid a legal wage. 



Limited Enolish -speakiriq and vocational education , ^n 

1971-72, nearly b percent of all vocational students wetfe 
Hispanic. This percentage is probably higher than the ' 

;percentage of Hispanic people in the total population. 

.'Three years later, Hispanic students comprised 5,7 
percent of the vocational education students. 24 

A 19'^6 Study identified ninety-eight vocational trkining 
programs for bilingual students. The largest number of ^ 
programs operated in California (37) , while twenty-seven 
states operated none«^Th6 frequency distribution by states 
appears in Table 3.3.23 ^ 









Number of Proarams 


States 


Percent of Total 


0 

4-6 
7-10 
11-13 
14-17 
{ over 17 


29 
14 
5 
0 
0 
1 
1 


58% • 

28% 

10% 

0 

0 

2% 
2% 




Total 50 


■ 100% 



Under the Bilingual Education Act, 500 local education 
agencies have received funds to improve the educational 
opportunities for students^ in sixty-eight language groups, 
and to expand educational access for more than 300,000 
children of non or limited English-speaking ability. In 
postsecondary education programs, one hundred institutions 
of higher education will offer teacher training and 
retraining to an estimated 25,000 classroom teachers and 
teacher aides. To develop a more effective coordinating 
relationship between the federal government and statfe 
"duc^tion agencies, forty-three state agencie"^ willTeceive 
. 'sii^tance contract money to carry out bilingdal education 
cu.-rdinatinq services within^ the state. As a means of 
insurina a growing and adequate supply of relevant and 
v]uality instri/ctional materials, fifteen Materials 
Dfn'elopmcnt Centers and three Assessment/Dissemination 
Centers have been funded tp support and meet the needs of 
rvipidly incrcasinq bilinqual education programs. "26 

Tht' Education Amen4nents of 1976 require that 20 
r'"r'.ont of the vocational education allocation be expended 
.'n tno disadvantaqed and limited English-speakinq . This 
rt>iuin'ment authorizes the establishment of remedial proqrairs 
t'uf '<\\c liiritrc' tltuj Ti jjh- speak inq . 



Wonu/n ^ 

W orno n and l ooislative action ^ Se vc r a 1 f ode r a 1 1 aws and 
oxecut I ve" orders have been passed to protect women from 
discrimination in education and employment. The Equal 
Pay Act of 196 3 r^revents sex discrimination in the'>cayment 
of wages for dqual work and in overtime and fringe benefits. 
Title VII of the Civil Rights Act of 1964 forbids dis- 
criminatiOTi in r>ublic and private companies and educational 
institutions employing fifteen or ^more workers. The law 
applies to h.l^inn or firina, wages, fringe » benefits , 
assianments, prorotions, working conditions, and employment 
priviloaos. rxocutive Order 11375, a revision of Executive 
Ordtu^ 11246 , requires a cK)vernment contractor employing fift^' 
vr\rsons or more and whose contracts total more than $50,000 
toXhavo a written affirmative action prooram on file. 
Titrv-iX of the Education Amendments of 1972 prevents all 
f^ublic and mcM^^' ^^rivate educational institutions from 
il iscr iminat inc oc-ainst women in admissions, fed^jxal financir] 
assistance, assionment, and staff employment practices,27 
Table J. 4 idtMUifies the provisions of these actions. 

The Education Amendments of ' 1976 require states to 
dt^tai 1 their action aga4-ti^t sex bias and sex stereotyping 
m vocational • oe^ucation • The Act provides sSupportive 
services tarnetod for women who prejDare to enter non- 
traditional lobs, displaced homemakers, sinqle heads of 
households who lack adequate skills, and homemakers who 
work part-timf^ ^nit seek to work full-time. It requires 
states to dovolon five-year plans that include provisions 
for equal accnsE^ to men and women in vocational education 
t^f t orts. j-^unds nay also be allocated for national programs 
in research, curriculum development, auidance, and cbunselina, 
»^te» aim^ed at overcomina srx bias and sex s tereotyping, 

Wymt^n arui voctit ion al oducat i on . Steele*^ Project Base- 
lir^M^ rt^])or t* slfows ihaT in 197 3 , women accounted for over 

f^t^fonnt 'O^ <^ M vocational education students. 28 ^he 
il i 1 I hu t i nn e^' v;cm>n by educational level apjM^ars below: 

xron t of Tet a 1 Po fcent of Women i n 

Voc'iit i cMia 1 Educ\il Vocational Education 

Tiu-n 11 mtM'it it Pr-oarams at Karh Le\-^M 

• n . 11 .JO 
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Tabls 34 



Lagislattve Action AffBcting Women in Education snd Employment Opportunities 



Titfe Vil of the 
Civil Rights Act 
of 1964 as Amended 
by -the Equal Em- 
ployment Oppor- 
tunity Act of 1972 



AH employers with 
15 or more em- 
ployees, emptoyment 
agenda, dgni labor 
organizations. 



Discrimination 
against employees 
on the basis of 
race, color, 
religion, sex or 
national origin 
(e.g., salaries, 
hiring). 



Executive Order 
1 1246 as Amended 
by 11375 



All org^izations 
holding federal 
contracts or sub- 
contracts of $10,000 
or more. All organ- 
izations, agencies, 
and institutions 
holding federal con- 
tracts or subcontracts 
of $50,000 or more 
are further covered 
by the order's re- 
quirement for de- 
velopment of a 
writteh affirmative 
action plan. 

Discrimination 
against employees 
on the.'basis of 
race, color, sex 
or national 
origin (e.g., hiring 
upgrading, firing). 



Equ^l Pay Act 
(Amendments 
of 1972) 



All employees. 



Discrimination 
against employees 
on the basis of . 
sex (e.g., pay- 
ment of wages 
including fringe 
benefits). 



Title IX of the 
Education Amend- 
ments of W72 



All education agencies 
and Institutions 
receiving fiaderal 
asslstsioe. 



Discrimination 
against students 
on the basis of 
sex (e.g., ad- 
missions, finan- 
cial aid). 



® 



Agency 
Administering 
the Actidn 



■J 



Title VII of the 
Civil Rights Act 
of 1964 as Amended 
by the Equal Em- 
jlipyment Oppor- 
tunity Act of 1972 



EqL(al^pnployment 
Opportunity 
Commission - 



Tabte 34 - oontinutd 



Executive Order 
1 124.6 as Amended 
b/11375 



Office of Civil 
Rights, Depart- 
ment of Health, 
Education and 
Welfare 



Bqual Pay Act 
f Amendments 
of 1972) 



Wage and Hour 
Division, 
Department of 
Labor 



Title IX of the 
Education Amend- 
ments of 1972 



Office for Civil • 
Rights, Department 
of Health, Education 
Welfare 



9 

•D?w1fil^ol°tho c^"'"" ^^'^ Education under order NIE-P-76-0240 v^ith the Multicultural/Bilingual 

?mZtioL%lt^^^^^^ f'^'^:'^ flZ""^' «^ Discrimination in Educational 

Institutions. National Institute of Education, Department of Health, Edift:atlon and Welfare, 1977. 
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In wage eartving vocational progr^fi, -femalea iKiaj^rised 
I pei^ce^t of^ the health programs/ 76 percent of the office 
programs, and 8iS percent of occupational home economics. 
t^i^<rer, males were a majority in eight agricultural programs, 
"^burieen distributive education programs , twenty-two technical 
prb^rams, and fo^ty trade and industrial programs. Tht^s, 
in 1972, boys had three times as] many options '^s^ girls in 
vocational education. 2 9 

V Furthermore f accord^i^p&d the 1970 Bureau of Census 
tabulations, 50 pefcen^ox employed women were concentrated, 
in twenty-one occupations while 50 percent of employed males 
were spread throughout sixty-fiye of the ^cupations listed 
in 1969.30 

•■ Judging from these findings, St^^e concluded that the 
educational system was onot preparing &male students < 
realistioally for the lives they \g^e \ikely to' lead, ' / 
noting that while adult women are increasingly seeking 
paid employment, adolescent gi^s are s\ill choosing 
courses which either do not prepare them for paid employ- 
ment or prepare them ^o work only; at low status, low paying 
jobs, 31 • ' • . 

A more recent study notes that since the en^^ctment of the 

Education An^^ndiqents of 1976, some states and local schools 

are operating programs to addresSv the sex fairness problems 

in vocational education. Highlighted programs are summarized 
belcw.32 

o Program Operator i Texas Department of P,ublic Instruction 

Program Activity : "Project EVE" is designed to inform 
young women regarding the' full range of job opportunities 
available and to recruit them for nontraditional programs. 
A program in nine Houston high schools' introduced girls 
to nontraditional jobs through a special career day* This 
included tours of their own school's vocational 
training facilities; a slide show depicting the historj 
of women at work and showing women in nontraditional 
jobs; and a mini-course on how to plan for the future. 

Changes Noted ; In 1975, thirty-nine girls were enrolled \ 
in nontraditional courses in all nine high schools. In 
1976, three times more girls were enrolled. 




-46- 



o Program (^©rator : Worth Carolina 

J* 

Program Activity : Hie Nigw Pioneers Project ^o Eliroinat© 
Sex Biasing in Occupational Education is trying to 
change attitudes among state vocational education 
staffers, guidance counselors, and students. Started 
as a pilot offered at ten schools in 1974, the project 



emphasizes the need for both sexes to plan for a life* 
time when ^ they choose careers. 
* '. «..••■'• , • 

Changga Noted ? One year after the pilotf began, female 
enrollments increased -six fold in brick layino, four 
fold in farm production, three fold in carpentry, 
while male enrollments doubled in food, nutrition, 
housi^a, 'and home fumishina. 

► Program Operator : Eli Whitney High School, Brooklyn, 
New York ^ 

Program Activity : Since 1973, all ninth graders must 
^ spend a month on each of the ten vocational tri^ainirig 
. areas offered at VThitney^ The theory behind the program 
is: . when the students reach the tenth grade, they will 
be better prepared to^choose a career on the basis of 
interest and aptitude, rather than according to sex 
"Stereotyping. ' 1 ' 

Changes Noted : In 1977, about twelve students will 
. graduate In non traditional areas. Also, 'student 
behavior and personal appearance has ch^ged.V 



Other local programs include ^^^-^ | 

9 

o Gulf Coast Junior College — training womfen as 
apparent ice pipefitters, boi'lermakers and sheet 
metal workers. 

o Southwest Kansas' Area Vocational Technical 

Educli^tion School — training women to drive trucks.' 



District of Columbia public scnbol system and the 
Chesapeake and Potomac Telephone Company — joint 
training program for women as phone installers and 
cable splicers, and n^ales as operators, 



According to Lehmann, "These efforts hre'shov;ing up 
in national enrollment figur'es. Young wom^n in trade and 
industrial courses rose from 11.7 percent in 1972 to 12.6 
percent in 1975,"^whirc the number of boys in home economics, 



office, ana h^aitD training ooiupses alae inoVeaaed 
Meanwhile, the pereehtage of girls in all types of hoa© , 
©conoBiie's courses— those for future housewives ks well as 1 
tho&e that are job-orienited<— declined. "-^^ "» . 



4 
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16. 

17. 
18. 

19 



22. 



23. 
24. 

25. 

26. 



27. 

28. 
29. 

30% 
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SECTION 4 

« • . . " . '. »• • • ■ 

ISSUES 'aKD STRATEGIES FOR FOLLOW-UP 
OF SPECIAL POPULATIONS 

• ^ ■ 

This section focuses upon issues and strategies tbat, 
ar© related to conducting., follow-up studies of special popula 
tions in vocational education* Issues and strategies 
associated with serving, the handicapped and disadvantaged 
populationk are highlighted. However, it is felt that the 
issues and strategies of fdlXow-up will be/ to a large 
extent, cohimon across' most special populations due to 
commonality, in definition. " Essentially, special, populations 
,ar®s^dentified as such because they require special support 
services to succeed in regular vocational programs. Thus, 
the need to systematically and effectively evaluate voca- 
lAonal instruction and special services duch. as counseling, „ 
program modifications, and tutorial assistance will be 
largely similar regardless of the special populations . ' 
being described. , 

The section has four focal points. . The first is a disfcus* 
sion of legislative mandates pertaining to evaluation of pro- 
grams for special populations. The second describes a series 
of issues associated with follow-up studies of special groups. 
The third highlights the ma.jor support services and program 
modifications to be evaluated. The fourth offers' a series 
of recommended strategies 'for conducting mail, telephone, 
interview, and c as e** study follow-up assessments. 

Legislative Mandates , j 

The JBducatim J^ndment^^of ..JJ-76-4P^ -&4-4^^ , -spexriL-f- 

ically Title II - Vocational Education, hav^-instituted major 

^changes in the design", delivery, and evaluation of vocational 
education throughout' the nation. Two majo;: .themes of 
particular note in the legislation include: '-''4^1) increased 
attentiortyto meeting the occupational development needs of 
special p|3pulations, including the handicapped', disadvantaged, 
minorities, wothen, and persons of limited English-speaking 
ability, and (2) increased emphasis on the planning 
and evaluation of local and statewide vocational 
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edy^lion programs./ ^id section addresses ^'sev&ral 
issues, piifobXeiRs, sbid strategies fourid in the epmmonalit^ • 
of these two theines. Section 112(b) of PL 94*4Q2 d^tscribes 
the obligation of the State Board of Vocational Education ^ 
to conduct evaluations of each supported vocational program 
at least once during a five-year period. Section 104.400 
of the Federal Register (October 3, 1977) describes the 
rules and ^regulations implementing this section, the ^road 
evali^ation areas includes ^(1) planning antS operational 
processes} (2) results of .student achievement; (3)/ results 
of student employment success; (4) the results of additional 
servicesv as measured l?y the suggested criteria above that 
the. state provides unoer the act for special populations. 
Section 104,404 of the Federal Register (October 3« 197*7) 
reads that special data on coillpleters and leavers includes 



lt)4.404 Special data on, completer^ and leavers. 

(a) The State shall evaluate, using wherever 'po^ible 
statistically valid sampling techniques, the 

. effectiveness of each program of vocational 
education Which purports to teach entry'^lavel* 
job skills. 

(b) The State shall evaluate each of these, programs 
in or^er to asbertain the extent 'to which both 
those students who complete a program and those . 
students who leave before completing a programs - 

(1) Find employment in «3Ccupaftions related to 
their training; and " F 

(2) Are considered by their employers to be 
well**trained and prepared for employment. 

(Sec. 112(b) (1) (B); 20 USC 2312^ 



1 Mandates for evaluation of programs and services for 

the handicapped population can also be found in 94-142, 
Section 1413 (a) (11) . Each state's annual program plan 
for education of the " handi c a p ped ^ » must' In elude' 
procedures for. evaluating at least annually the efnective- 
ness of programs in meeting the educational needs af 
handicapped children, including evaluation of individualized 
education programs, "J^ A similar mandate for evaluation is 
contained . in the federal legislation implementing aom- 
pensatory education? however, the disadvantaged students 
served are typically preschool and elementary age ant5 thus 
do not participate in vocational programs in most ste.tes. 
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Need for Evaluativ© Data ■ * - 

Hie need for valid and reliable evaluation data is 
in^rative. Since the late 1960 *s the cfrowth in educa- 
tional programs and appropriation ^or special population 
groups have been steadily increasijig. As ^ result of the 
civil ri^ts movement, many- groups that haye been previously 
excluded now have access to vocational education. Within 
the next few yiaars, the federal and state legislatures » 
advocacy organizations.^ and other policy making groups 
will be demanding some eviden&e that the specj.al populations 
are being ef fe,ctively served. The question's, for vocational ^ 
education, of course, will focus upon the* extent to which . 
these individuals have been successful in^obtaining 
employment, • , ' » 

' In addition to requirijig justification for' continued 
apprbpriations , data will also be needed to examine • 
possible changes in rules and regulations that guide .°the 
implementation of programs. Several new major provisions 
were introduced as a result of the 19^6 Amendments (e.g., 
excess cost funding and matching. by |)urpose) which could < 
prove to be disincentives instead of incentives f6r serving 
special groups in vocational programs i Changes. in state 
guidelines, and. regulations may also be required to sup;^ 
. piemen t the federal regulations. Informed decisions regarding 
the revision of regulations can only be made if good impact 
and follow-up data are available. 

Follow-up data are critical to the long-rang'j improvement 
and expansion of special needs services and programs. A 
critical analysis of the effectiveness of support services, 
such as remedial instruction, special materials, and vocational 
counseling can be made, in light of student achievement and 
labor market success. ^The results of the analysis can assist 
local administrators in revising special programs and support 
services from a comprehensive information base. 



Critical Problems 

The critical problems of follow-up assessment can be 
classified in three areas: definitional problems, problems 
in determining user information needs, and measurement 
problems. 



pQfinitlonal pgobl@Rig , As noted earlier, special 
populations are designated ai such because th©y require 
modified progr^s and/or supportive rviees to succeed in 
regular vocational education programs. However, there is 
little commonality in the legislative and regulatory 
definition of these groups. The fallowing is a series 
of |>rofalems that must be considered by planners of 
follow^-up studies: 

1 . liidividual versus group identification . The 
ieglslati^ requ^^e tnat the handic^ipped and 

. disadvantaged bey^ntified on an individual basis. 
The support services to be prescribed must be . 
focused. on enabling each student to succeed in a 
vocational program. However, women and persons of 
limited Inqlish-speaJcing ability (LESA) are identified 
and prograiwned for on a group basis. Obviously, 
follow-up data must target uppn the labor market 
success of both individuals and .groups. 

2. Federal versus state definitions . Frequently the 
state education agencies' definitions for the terms 
"handicapped" and "disadvantaged" differ from the 
federal definitions. For instance, some states 
use the term "educationally handicapped" to refer 
to students who might be defined as academically 
disadvantaged under the 1976 Vocational Education 
Amendments. Also, there is variance in the range 
of disabilities included in state legislation. 

For example, the gifted and talented presently are 
not included within the federal definition of 
handicapped, but 21 states have legislation which 
includes this group within their definition of 
handicapped or exceptional. 35 to the maximum 
extent feasible, persons planning follow-up 
assessments must clearly identify .he appropriate 
classifications to insure that the -ollow-up 
data are compatible with state and federal informa- 
tion systems. 

C ausal and functional inconsistency . Schneck, 
Lerwick, and Copa note that both causal and func- 
tional definitions are necessary when describing 
the handicapped and disadvantaged populations. 
Causal classifications refer to the source of the 
disability (e.g., brain injury), while functional 
definitions define the operational effects of the 
disability (e.g., reading below grade level). 
Causa J definitions are needed for accountability 
(jurposes, while functional definitions arc necdf^i 
to i)lan special services. 



The classification of "econc^ically disadvantaged 
represents a causal definiti,on without a related 
funcMonal\.coinponent . Becausd stud,@hts cbBie from 
a family with an annual ineoine be»low the poverty 
level, it must be "assumed" that; they rei^ire . 
special serv^es. With this target group" the 
causal-functional relationship is often incbnsis^ent 
and unclear. Planners of follow-up 'studies may. 
0 find it difficult to identify Mand thus evaluate)^ 
the special services provided to ecotiomically 
disadvantiaged youth. Similar causalrfupctional 
inconsistency pro'b^ems become apparent when • 
noneducation identif icatibn criteria, such as^he 
status of the "individual* s lemployability (e.g., 
unemployed or underemployed) sex, race, and income 
level are used. g 

& if • -• 

Problems related to user information needs . The uhea • «> 
and users of follow-up assessment information are diverse. 
Determining who needs what kind of iriformatioh is a major 
task for individuals responsible for planning an^ operating 
follow-up systems. > ' 

1. Purj^oses of information . As npted earlier , follow- 
up information describing the employment status of 
special populations is critical to policy revisions ■ 
and refinements, continued or expanded appropria- 
tions at the federal and state level, planning future 
programs and services, and career planning of 
incoming students. The information can b^ used. for 
a multitude of purposes, ^including demopstration of 
compliance i i^^aping policies and- legislation, 
program evaluation and management, and guidance 
services. With multiple purposes existing, it is 
difficalt to give priority to the. specific • 
information and data to be coj^lected, sampling 
procedures, information sovirces to be contacted, 
and procedures for preparation of reports. Thus, 
it is incumbent upon the planners of follow-up 
assessment studies to judiciously manage the 
overall blending of tho diverse purposes of a givesn 
follow-up study. " 

Typos of informati on. Along with diversity in 
purpose there also exists diversity in the type of 
information to be collected. The principal purpose 
«.)f the follow-up will shape the typo of information 
collected. The Fe der al Regist er regulations cited 
(••nr-lier emphasii'.e the need to collect follow-up 
1 n f or ni'U i on for e va 1 iial i na the effects of special 



services bpon planning and operational processes, 
' student /achievement, hnd stuclent employment success. 
. Hiafeo'rically , data describing the vocational 
student's labor market success have been con- 
sidered the most important in policy and legislative 
decisions. Howevefr,. With an increase in the number 
of specia-l .populations students, it would appear 
that equal emphasis will be placed on the effective- ' 
ness of plann^.ng. and operational processes, learner 
achievement, and labor market success. The need 
for specific types of information will vary across 
communities and progr^s. 'Pleginers of follow-up 
studies .should attempt to collect information 
consistent wit^ the overall purposes of the study. 

utilization of existing ^ata collection and 
evaluation systems . Sev^al national anpHfftB^Q,^,^^ 
level data systems have lleen implement^C to impr^e 
vocational education plsmhing as a result of the 
1976' Amendments. -The National Centtx for Education 
Statistics is responsible for developing and operating 
a national data system which compiles data oh 
enrollments, completers and leavers, expenditures, 
staff, 'and facilities , 37 xhe National and State 
Occupational Information . Coordinating Committees 
.were established in the same A'ct to Coordinate the 
•collection and dissemination of occupational 
information across sieveral agencies.. The National ' 
and State Advisory Councils on Vocational Education 
are charged wi'th evaluating vocational education 
efforts annually^ In adc^tion^ a n]jfDber of states 
have well-established managSirent information systems 
which collect critical dc.ta as required by state 
leaislatioh and related information needs. The 
reader is referred to section six of this handbook 
for 'a moro ■ de tai lebd discussion on the uses of follow- 
up data and information. Following an in-depth 
study of the service need requirements of handicapped 
and disadvantaqcd Students in vocational-technical 
education proaraiT\s in Minnesota, Schneck, Lerwin 
and Ccua noted : 

There are a larae' numljer of aaqncies involved 
in providincj so rv ices to handicapped and/or 
d i sadvantaaod uorsons in vocat iona I ' educati on . 
There is a stronq need for coordination of 
definitions and manaqemcnt information within 
And between these auoncies. Consistent proaran^ 
and :^t'rvi<'<' t. e rnn no Uxiy is n<?eded. The manaae- 
irent int'orration system neoc's strict compliance in 
d.af.a iru'.it .i:\<.l rcni 1 1 (.>ri no f->f' ani],vsis and out{'Ut. 



# 



To th© ipaxinuip extent appropriatf, planners of 
follo«r-up assessments should be familiar with 
and utilize- data collected by existing system^. 
However, caution should be exercised to insure 
that the data obtained from existing systems 
are valid,' reliable, and comprehensive. 



4- Determining appropriate information sources ^ 
Typically, follow-up studies use the student 
who has completed or left the program as the 
principal information source. The new provisions 
for state board evaluations incorporate the° I 
employer's assessmertt of the perfdrmanee of voca- 
ti(^al education students a*s compared with the 
performance of persons whp have not been .enr<^lled 
Vin vocational education , programs. ''^ 

With the increased participatitjn o§> parents • 
%nd .aOyocates in the planning of educational programs > ■ 
for Aheir children, such as that reflected, in ' 
the (Education for All Handicapped Children Act 
of p75 (PL 94-142), these individuals have to also 
be/ considered as a key inf Crma^on source for " ' ' 
foaiow-up. assessments. ;> In addition, representatives 
of various supporting agencies, such as vocational* 
rehabilitation and CETA4 can provide useful 
information concerning the status of supplemental, 
transitional, . and continuing support services. 
Within the resources avail,able, efforts should be 
made to 9b tain follow-up information that is 
. considered essential and useful from a variety of 
\ sources. ^ 

\ Measurement problems . There, are several problems that 
are associated with obtaitiing and interpreting information 
that descrifcHis student achievement or labor market success. 

Conf identic-. lity of records . Recent federal legisla- ' . 

tion and regulations have -limited the accessibility. 

of personally-identifiable information contained 

in school records. Strict policies have been 

adopted concerning the storage, disclosure to third ^ 

parties, retention, and destruction of student 

information describing a student's in-school 
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performance. and th@ support s@rvleas provided. 
Persons qonducting follow-up &sg@ssin@nts will have 
to: (1) petition for access -to' r@eord@,, and (2) 
provide assurance that th@ information will not 
b@ U8@d in a manner that permits personal id@ntifiba°> 
tion of student (s) involved.' ' • • 

Inter preting nyi-diaeriminatory asaessment provisions . 
PL^4<-l42 requires that testing and evaluation 

i^t^rials and procedures that ar^ used for purposes 
of evaluating handicapped students be selected 
^d administered so as not' to be racially or 

, culturally discriminatory. ^ Evaluation procedures 
must be administered i-n the student's native 
t®ng^ or other mode o^ cpmmuni cation. Tests must 
be deigned or selected and administered so as to 
ensure that when they are administered to a student 
with impaired sensory, manual, or speaking skills, 
the te^t results reflect accurately the individual's 
apti^de or achievement /level, rather than the 
impaired sensory, manuaP, ^dr speaking skills. 

In son@ instances this will necessitate th^ 
use of additional per^sons or resources for col-; 
lecting fol^w-up information. For- example, 
interpreters'Utay have; to be hired to support the 
irfteryigying deaf .students-. Follow-up instru- 
ments wf 11 have to be prepared in multiple native 
languages in 'some states. Special or modified 
versions of standardized tests?, such as" the 
Nonverbal Aptitude Test Battery, should be utilized 
whenever feasible.' Otl^er modifications to in- 
strument at i^on and administration. procedures are ' 
described i^ter. ' . 

Lack of good measures of severity . It was noted 
earlier that there is consider aBTe diversity in 
defining existing educational handicaps and 
disadvantages. in* additi"bn to knowing the type 
of handicap or disadvantage, it is important to 
assess the severity of the disability. Numerous 
cost studies have shown that the costs are con- 
siderably highet" for educating students who are 
severely mentally or physically handicapped. To 
accurately weigh the accrued benefits of vocational ^ 
programs, the severity of the student ' s •educational 
problems must be known. The severity of mental 
probl€>ms is obtainable, from test scores. However, 
thero are f<?w scales for measurinq and classifying 
ti-.r- i5civority C'f individual physical, behavioral, 
i»r cuitural proljlpms. 



4. Identif ying entering parformanee levels , in order 
to systematically ass^ss^th@ £@ctiv@n@ss of social 
programs and support services, it is critical to 
know the student's level of performance upon 
program entry. _;a^er than for handicfapped students, 
limited diagnostic ^ata are compiled for identifica- 
tion, screenincT, and referral of special needs groups. 
Whenever possible, it is incumbent upon planners 
of follow-up studies. to obtain and use information 
that describes the' student prior to the program. ^ 

• 

Program/Support Service Components to be Evaluated 

In addition to the labor market participation of former 
students, there are numerous service and prograin components 
that can be focused upon in follow-up assessments. Key 
questions concerning the availal^ility, extent of barticipa- 
tion , perceived effectiveness, and recommendationsVfor 
improvement can be posed for each of the following^ ^ 
components: . ' 

Instructional Services 

Vocational education instructors 
Basic education instructors ^ 
Readers/interpreters 
Remedial tea'chers/therapists 
Instructional aides/tutors 

Instructional mat^erials • ^ - 

Testing and diagnosis . • 

Cooperative work experience instruction 
In-school occupational instructioii 
Prevocational instruction 

, Supportive Services 

Guidance and counseling 
Social work and family counseling 
Work evaluation services 
Transpor tation 

Field trips and community resource uti lization 
^ wJob placement services . * " 

' ' Follow-up services 
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Facilities and EquipiReht 

' Oecii^ational lab ^ilities \ ' 
Occupational program equipmefft 

Kgcruitment and Enrollment 

Identification, of students 
Recruitment materials and information 
Adv#rtis£ng 
Referral procedures 

Strategies and Methods of Follbw-up 

<? 

{ Administration . Administration of follow-up studies for 
handicapped and disadvantaged students is not significantly 
different procedurally than for other groups. Whatever 
n^thod is chosen for data collection, the adminisjtration 
of the study contains the same elements. The major dif- 
ference is in deciding whether to use one of the survey 
procedures or alternative methods. .V 

When general populations are studied, the mkil, 
telephone, ot interview survey type 'study is fluently 
utilized.. The survey is efficient and lea,st expensive 
to perform 'v^en the population does not require^' special^ » . 
considerations regarding data collection pi^'cedures or 
instrumentation. General population studies do not require 
S/taff trained in other .than survey technique, but studies 
focusing on special populations do. This becomes' an 
administrative problem, b9th in terms of cost and flec- 
tion of personnel. ^ . <?>^- • \ 



The key administrative item is selection of personnel 
who are knowledgeable about special populations. The 
needs of this^coljective group, their sensitivity 'to 
relationships with others, andprpblems peculiar to their 
needs must be takerf into account in thfe total process of 
planning follow-up studies. General rules for conducting 
a follow-UD study apply, but additional elements recogniiing 
the' rules' uniquenesses, must be stressed. Therefore, 
individuals responsible for follow-up should be cognizant 
from experience of the di-stinctions in working with these 
oroups of p ople« 



.. w .... 



P^ooedure an d inatruetio n. Reqardinl iWfewentatien , 
ther© ar© probTeMspeculiar^o each, type ©t' ^©c3al need 
and each survey procedure. One p^roblein of a qeneSl mature, 
the intention to pleas©, «• is frequently the response, of the 
spe.eial student. Its root is in the educational system.' The 
experienced spe(&Lal student may have learned the importance of 
smiling and nodding "yes" when the teacher 'asks "Do you 
understand this?" or shaking her/his head "no" when the teacher 
asks Are there any more questions?" 41 Thus, if the instru- 
ment is threatening in any way, the response to subjective 
questions could be -a measured response with intent to .please. 
Care should be taken to ensure that the design of the 
instrument does not generate subjective responses and 
contaminate the data. 

Each type of handicap demands consideration in instru- 
mentation. For example, a blind or partially siahted in- 
dividual would require a survey, in braille or one with large 
print and response spaces. If the identification of the handi- 
cap does not inclAide the degree of sieSitedness , ■ a survey form 
could not be designed to relate to^he needs of the individual 
surveyed. Even if the degree of ilght is known there exists 
the problem of someone assisting -the subject in completing 
the survey and ±hat person's bias seeping into the response. 
A telephone sufvey or personal interview mioht be appropriate. 
The inslrumeRt in that situation must be adapted for oral 
trans latiioa/by an interviewer with Questions designed for 
shortest possible answer. The problem lies in the communica- 
tion b^ween interviewer and subject and tfie amount of 
interpretation of response that occurs*. Also, the speakinq 
voice of the interviewer must be considered in the selection 
of personnel. 



Other handicaps which affect the subject's ambulatory 
abilities need also be taken into account. If the survey 
procedure is to be used, knowledge about the degree of 
handicap will determine the choice of mail, telephone, or 
personal interview survey.. A combination of the three kinds 
may be required to meet the needs of people with widely 
divcrqent dearees of handicap. 

In situations of hearing loss, the telephone survey is the 
least desirable. Even personal . interviews can be difficult, 
dependina upon the severity of the. hearing disability. In 
most, cases, this handicap calls for a mail survey, the process 
which least challonqes the abilities of -the subjects. When 
irail surveys are used, the readina level and conte|it must be ' 
commensurate with the lanouaae ability of the respondents. 
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The r«adability|6f the instrument must be matched to 
the^ person reading It.'. Not only must it be clear, concise 
and objective, but'iljt must be able to be comprehended by 
those who respond to^ifc. At the time of validation, it 
woifld be necessary to determine the level of reading abil- 
ity^ required to understand the information sought. A 
question which Ms been qualified^ assure the' highest 
degree of objectivity of clarity of intent may, via the 
qualification, have been increased substantially in regards 
to its i^eadability. Procedures for determining the 
readability of an instrument are defined in Section 5 of 
the handbook. The reader^J.s encouraged to review those 
techniques and procedures.^' . 

^ Figures 4-1 through 4-7 on^the follcwing pages, 
^ summarize 'the 'special considerations to-^ made in select- 
ing or developing and using evaluation instruments with 
special nfeeds populations. ' 

In a personal intp-rview, the neutrality of setting 
become's importanW-^t is difficult to interview a' person 
when fanvily or friends are present. In addition to 
interruptions, the' results can be contaminated jjy the 
subject's self-im4ge in relation to family and friends and 
the subject's pertepti'on of how her/his responses swill be 
interpreted. 

» 

An office interview, if private and uninterrupted, is 
generally thought to be the mbst neutral*. However, if thkt 
9f fice is located in a complex with which the subject is 
familiar^ (the director's office or counseling office in the 
subject's former school) results can be contaminated by th^ 
attitude of ^ the subject about what that setting represents. 
Whenever, possible, the office interview should be cohducted 
in a neutral office, one not associated with administration 
9r teachers with whom the subject is familiar. 

The interviewer, in a personal, interview, irfay create 
bias by appearance,, attitude, and presence. Overly casual 
or unduly formal appearance or manner may cause the subject 
to relate to the interview in different ways. There are 
no prescriptions for avoidance of this possible bias. 
Caution must be exercised so that rapport with the subject 
is not unduly influenced by some nuance that is irrelevant 
to the purpose of the interview. 



figure 4-1* 

' Special Comiderations for Follow-up 
for the Mildly Mentally HaitdiSipped 



Use vocabulary and language that Is extremely simple and concise. 
Makejthe sentences as short as possible. 

Verify that the information to be read is at or below the learner's reading level 
in terms of difficulty. 

Use nonverbal response scales whenever possible. 




Permit oral p^resentation of questions to provide simplification and clarification. 
Permit interviewing to take place In short sessions over several days. 
Provide simple directions and several examples for responding. 
Use only concrete, meaningful items. 

Repeat directions or other essential information until overleaming occurs. 
Use some modes for re^onding other than writing whenever possible. 



Sptsial Consfaionitom for Follow4j|i 
oftlioBlindorPistiailySiihittI } 



Use instruments prepared in braille. 

Use instruments with large print. ^ 

Use auditory modes instead of visual modes of eommunficatlon, such as 
Cluestions on cassette tape. 

Use special or supplementary lighting. 

c 

Design instrument using tactile discrimination. 

Arrange for students to respond in braille or use a cassette tape recocder. 



Figure 4-3 

SpMial Considerations for Follow-up 
of the Deaf or Hard. of Hearing 



Use a total communication approach that Includes lip reading, signing, and 
finger spelling. 

Provide favorable seating for partially hearing students. 
Employ ne^sary sound amplification devices. 
.Use special devices to improve acoustics. 

Have.the instrument reviewed for interpretation by manual communication. 
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Special ContldaratloQt for FollowHip 
* ofthaLttmjjpD^led 



Use modes for responding that do not involve extensive writing or speaking. 

Have instrunnents an4 proc^ures reviewed by a learning disabilities consultant 
prior to \xn* 

Watch the student carefully for cues that difficulty is being encountered. <> 



Figure 4*6 

Special Considerations for Follow-up 
of the Physically Handicapped 



Provide large response boxes for individuals who exhibit poor fine motor 
Xxwrdination. 

Provide adaptive furniture or equipment where situations or environment 
warrants It. . 



Figure 4-6 

Special Considerations for Follow-up 
of the Emotionally Disturbed 



V t 



■ ■ f 

Prior to interviews take steps to insure that the follow*up situation is 
non threatening to the extent possible. 

iWatch the individual in a follow-up interview to spot potentially disruptive 

^situations. 
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^- Fi»irs47 

SpecUd ComtdarstioRi for FollQVtf4ip 
of the Limitsd or Non*EnoHih Sft^ing 



Have follow-up instruments translated to the native language. 

Have a bilingual person^to administer the instrument. 

* % 

Consider very carefully thb cultural fairness of your follow-up Instruments 
or Inteiview schedule. Jo what extent do the procedures or instruments 
point out differences among cultural groups that are based on 'language, . 
reading speed, or culturally loaded rantent? 

_^ ^ . 

The case study: a. feasijaie alternative . Two factors 
suggest movement away from the- survey toward the technique 
of the case; study: (1) the difficulties inherent in the 
survey when applied to special populations; and (2) the 
subjective elements of follc5Wing-up a special group. 

The problems, peculiar to use 'of a survey ' instriament . 
for follow-up of handicapped and disadvantaged persons 
are contained in the previous discussion. They include 
decisions related to: (1) recognizing the degree and kind 
of capabilities or disabilities that result ftom individual 
handicaps or disadvantages? (2) ^issuring the readability 
of the instrument; (3) utilizing the appropriate combina- 
tion of mail> • interview, or telephone surveys; (4) .selectirwg 
"special needs sensitive," experienced survey personnel; 
(5) defining individual problems associated with each kind 
of survey, as reflected in using them with various "special" 
populations. Each of these problems can be overcome, but 
the cumulative effect on the complexity of administering the 
study and potential for contamination suggests .the need 
for an alternative. 

In the 1977 "Plan for the Study of Vocational Educa- 
tion," the National Institute 6f Education indicated that 
case studies would be conducted on "Meeting Special Needs." 
These case studies will seek to "learn about the inter^ 
relationships among persons with special needs, types of 
and access to programs and services, and local labor market 
conditions and information . 2 
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■Case studies address the total individual, providing 
a profile on their uniquenesses j ''People, are not typical, 
they are individuals existing in definite ©nvi roninents , 
preserving unique abilities and eharacteristics . . , The >' 
case st.udy' method provides information about specific 
.persons, existing iristitutions or concrete entities . . . 
(and) must include biographical, phj^si^ological, environ- 
mental, psychological .. . '. data."'"^ 

Social workers have, long used the case study method 
to develop a profile sufficient for diagnosis and treat- 
ment purposes. . The information obtained from case studies 
is precisely the information. sought in. the follow-up 
of special needs populations. Specialists in th? subject's 
occupati<snal specialty and disability or disadvantage 
examine the. pertinent physical, environmental, employment ' 
and educational phenomena. By way of the case conference, • - 
an accurate scenario is developed; and educational and 
employment datd are examined in, the- appropriate context, ' 
On^ly by th.is method can speculation about^ the subject 
be eliminated. 

t , . ' . ' . 

The case study method can provide for the identification 
af student perceptions of . one's- family, social setting, 
school and employment.. Attitudes of family, acquaintance^, 
employers, and teachers affect the attitude of the subject. 
Thus, in using the case study method these attitudes can be 
scrutinized closely. ' For example, an 'employer 'js attitude ^ 
would be examined in the context of the subject's perception, 
the employer's self-analysis and other employees' observa- 
tions. The poirtposite profile yi^ids a, more accurate picture 
of the employer than would any si^dle consideration. » 

The case study method offers a positive alternative or 
an adjunct, given procedural problems inherent i^i the follow- 
up surveys when applied to special populations, and the sub- 
jective elements associated with follow-up studies of special 
populations. i - 
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SECTION 5 ^ o 

■ ^ PROCEDURES AJJD PRACTICES 
FOR FOLLOW-UP STUDIES . 

This section is an expansion of section 4.'*' it 
provides a detailed description of those procedures and 
practices for conducting follow-up st lies of special 
populations. . ' ' 

Althouoh many current evaluation^ practices at the state 
a^nd local levels include common ! instrumentation reporting 
ptocedures for special and non-special populations, certain 
considerations .i«ust be made to accommodate the physical, 
psycholoaical, social and emotional differendes that do 
exist. A number of these differences were highlighted in 
section 4. Tha acceptability of the procedures BXi^ 
practices furthejr defined in this section should be con- 
sidered in evaliiating their potential usefulness for 
follow-up studies of the special populations-, 

• The basic design considerations and practices offered 
in this section have been adapted and/or taken from 
Evaluation Handbooks; Guidelines and Practices for 
Condu ct'ipg Follow-up Studies, Volume One . '■ ~ 

C onsiderations for Collecting Follow-up Data of 
Spfc^cial Populations 

Dofining target groups is a prerequisite, for planning 
follow-up studies of special populations^. Developing a 
matrix of those to be included in the study should assist 
in determining the most appropriate type- of instrument or 
mpth'od to be used in collecting data. Characteristics of 
special populations are provided in section 3 of this 
handbnok. * 

The collection of pro-interview da ta--persona^ data, 
eciucation, training, and exper ience --is also reccWnended 
to help in the actual data collecting process and to 
identify the most appropriate method* and facilitating 
envi ronment. . 
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Hop priority must be given to the special needs- of the 
follow-\ip .respondents, fcx certain visually handicapped, 
mentally .retarded, orthopedically impaired, or limited 
Enolijjih-speakina persons, the conventional trailed question- 
naire has liF.itedo appeal. Each situatior^miist therefore 
be' evaluated individually in order to determine the need 
for- an "assistant and/or special devices (e.g., tape recorder, 
braille or large-print fornfsi to help the respondent comr 
plete the questionnaire. ' V 



A telephone survey may be a feasible alternative tp the 
iled questionnaire. Individuals with hearing impainne'nts 
_ special telephone amplifying equip- 

needs must be taken into consideration. 



ma 

are soiretirnes able feo 
ment. Acain, special 

The f ace-to-f -ice interview reauires a trained ini^er- 
viewer who is sensitive to the special needs of the re- \ 
spondent. Vl^enever possible, it is advisable to "match" 
the interviewer and respondent according to race, sex, and 
handicap condition, etc. Detailed interviews should be 
planned and rehearsed in pilot or role playing experiences 
prior to actual meetings. 

\ ' The major decisions and steps in the design and planning ■ 

of a follow-up stu'dy of former voca^tional students defined 

as special populations focus on four major concerns or issues. 

Theso include: ■ ' 

K Knsur irtig* that adequate attention is given to the 
task of developing follow-up study objectives 
which take into consideration the characteristics 
and needs of the special populations. 

.lo rdontifving techniques for the development of survey 
m.qtrumonts or interview schedules to collect infor-- 
mat ion fron^ formr^r students and employers. These 
i wcl ud^.^ : 

.\ . f^rmi ni nq ^juesticns to bo ^i.skpd { i. , e . , what 

data will h<^ colic/cttid) * 

I-* Pf »t f. »rri i n i nq th.^ most arvronriato f^^rmat. for tho 
L iif-; t runu'Mt or i x\t vrv \ v\< . 



c. Maximizing the readability of the inatrumsnt , 
pr intefpretability of the interview questions. 

d. Increasing the reliability an<? vali#ity ' ' '\ 
6f the instruir©nt» \ 

.. \ 

' e. Developing sex and ethnic eaui table language 

for the instrument and interview schedules and 
sensitivity to feelings and attitudes 
peculiar ^o special populations. 

f. Defining the most cost-ef ^'^icient and cost- 
effective method (s> for processing .the data 
and information obtained throurth the survey 
instrument or case study annroach, 

3. Implementing pi^edures for. ensuring the requirements 
from the Family Education Rights and Privacy Act 

{^(Public Law 93-380 and amended by Section 2 of Public 
^Law 93-568) . 

4. Defining the population and/or reoresen tative 

sample. ' ^ ' ' ■ ' ' 

These procedures wil^J^ described in detail on the 
following pages. 




Developing an OutM j ^ of Activities for 
Conducting a Mail survey Follow-up Stu('.y 

Defint^ the specific tasks and personnel responsir 
bilities in^a time phased network can increase the like"li- 
hood/ of a successful effort. Flowcharts delineating these 
actil'itics in sequence should #help to rinirize locfisti<?al 
problems. Fiaures 5-1, 5-2, 5-3, and 5-4, adapted from 
procedures defined by McKinnoy and Oalesby, delineate 
four phases in the design and plannino of follow-ifp 
studios: (1) prepara^Aon , (2) data collection, (3) data 
an •I vsis and report preparation, and f-^) c'issemination of 
fo.l '.ow-up study results. 44 



??;/.> * 



1 . D@v@lop follow-up study objective. 

2. Idsrttify 8p@cisl p^utatlons ano/or sampla ©f former students or employers to 1:^ 
included in follow-up study. ; ' 

3. Choose best method (cost-beneflt/cost-effectlve) for conducting follow-up study. 

. a. Mail questionnaire, 
b. Personal Interviw/. 
C Telephone intervitw,. 

4. Design questionnaire or interview »ehedule in consultation with Input from ill 
/ptepig Involved directly ^ indirectly in the educational and employment process. 

Thesi mdlude, but are not limHed to groups, such as administrators, jteachers, 
advisory- committees, boardis) of education, sta^e department of education 
personng^i, 

5. Obtam authorization for use of signatures from educational administrators who may 
be signing alert cards, cover letters and reminder cards/letters. * 

6. Obtain i^dresses of former students and prepare m^ter nddress file. 

7. Obtain necessary approvals to collect information on former students in compliance' 
with the Family Educational Rights and Privacy Act (Public Law 93 380 and 
amended by Section 2 of Public Law 93-S68). 

8. Establish mailing dates and prepare follow-up materials for mailing or identify 
interview dates and develop interview schedules. 
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Figure %'Z 

FoibwHjp Study Pha» 11: 
Data Collsetion Via Mall Survey 



1 . First mailing - altrt cards. 

2. Sscond mailing - cwtr letters and questionnalrts ^nt end of first w@ek. 
.3. First responsg inalysis: - 

a. Begin runrling count of returned, and completed questionnaires. 

b. Attempt to find correct addrt^es for instruments returned because of 
incorrect address. 

c. Compile address list for third mailing of non-respondents and corrected 
addresses. 

4. End of second week - third mailfng. 

a. Reminder cards for non-respondents. 

b. Questionnaires to corrected addres^s-instruments returned with "address 
unknown." 

5. End of third week - fourth mailing. 

a. Reminder letter and second copy of questionnaire to non-respondents. 

b. Continue response analysis. 

6. End of fourth week ~ fifth and final mailing. 

a. Send reminder card with cut-off date to non-respondents. 

b. Prepare telephone survey list of non respondents. 

« 

7. Conduct telephone survey of non respondents. 
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Figure 5-3 
FotlowHip Study III : 
Data Analytb and Report Preparation 



Identify data analysis proeeaing proradures-manual and/or sltetronic 
data proving. 

/ 

Define statistica[ techniques for data analysis. ^ 

Preparation of follow-up report. ^ 

a. Identify audiences for which reports) are to be developed 

b. Analysis of findings. \ ^ ' 

c. . development of nonrespondemSreport. 

Publication of report. i 



0^ 



0 ? 



Figure 64 

Follow-iip Study Pha» IV: 
Dissemination of Rosults 



1 . Identify groups td receive report : 

a. Administritors 

b. Teachers 

c. Advi^ry committees 

d. Bodrd(8) of Education 

e. Government agencies 

f. Employers 



2. Develop evaluation form to be incluued with distribution of report to assess useful- 
new, timeliness, read^ility, etc. 



3. Develop conference or workshop package to present findings at key meetings to 
achieve optimuni impact. 

• S ■ 

a. Local mmrwiGB workshops. 

b. Annual statewide conference on vocational education. 

c. Public hearings or meetings. 

4. Develop news mtdia article. • 



1^ 
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The first important step in th^ design of follow-up • 
studies is the development of objectives. Certainly the 
primary objective of compliance to satisfy federal and state 
reporting requirements roust be con8idere\fl^ With the passage 
Public Law 94-482, a declining resource base 'for a number 
of educational agencies, and a mandate to serve more 
individuals and provide more services, follow-up studies 
can and should be recognized as relevant. and valuable for 
program planning and decision making, evaluation, and the 
establishment of vocational education accountability. 
Theoretically, accountability emanates from the overall 
philosophy of vocational education, auid the two are 
extremely import art t reasons for develonina follow-up 
objectives. j 

The word accountability is open to- numerous interpreta- 
tions. For some, it means providing students with marketeible 
knowledge and skills for jobs related to field of training. 
Others believe accountability exists if vocational education 
provides knowledge and skills for improved career decision 
making, either for entry into the labor market or continuinc 
education. Account ability is a term which education in 
general and vocational education in particular has yet to 
define in precise and commonly agreed unon terms. 

The identification of an overall nhilosophy of vocational 
education and its corresponding goals, objectives, and 
outcomes is a difficult task. There seems to be little 
agreement among educators, especially vocational educators. 
However, a point of departure appears, in the vocational 
education legislation. The Educational /Amendments of 
1976 and the regulatipp's, for vocational education provide 
a basis for an overall philosophy. r,pecif ically , Section 
104.2 of those regulations states that: 



The Declaration of Purpoae»is to assist States 
in improving the use of all resources available to\fe4g^ 
States for vocational education and manpower training ^ 
by involving a wide range of agencies and individuals 
concerned with education and training within the State 
in the development of the vocational education plans. 

This part also authorizes federal grants to states to 
assist them: 

K To extend, improve, and where necessary, maint-ain 
oxisfcina programs of vocational education. 
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2. To develop new programs oJ^ -vocational education. 

3. To develop and carry out such procrrams of vocational 
education within each state so as to overcome sex 

. discrimination and sex stereotyping in vocatiortal 
education programs, (including programs of home- 
making and thereby furnish equal education, 
opportunities in vocational education to persons 
of both sexe^) • 

4. To provide part-time employment for youths who 
need the earnings from such erploypent to continue 
their voca^tional training on a full-time basis, 

so that persons of all ages in ^1 communities of 
the state, those in high school A those who have 
completed or discontinued their formal education' 
and are preparing to enter the labor market, but 
need to upgrade their skilTs or Yearn new ones, 
those with special educational handicaps, and those 
in postsecondary schools, will have ready access 
to vocational training or retrainina which is 
of high quality, whiph is realistic' in the light of 
actual or anticipated opportunities for gainful 
employment, and which is suited to their needs, 
interests and ability to benefit from such training.' 

A major goal contained in this 'declaration of purpose 
is to provide follow-up information that can assist in 
making decisions concerning "the development and improvement 
of vocational education programs. Evolving from this major 
ctoal are" four broadly defined objectives: 

!♦ Improvement, expansion, or elimination of vocational 
'■ education programs; 

2. Assistance in decision makina; 

3. Assistance in planning? and 

4. Assistance in evaluation and accountability. 

From the delineation of the four broadly defined 
obicctives, specific or "qu'estion-orientcd" objectivost 
are developed. Examples of such specific objectives 
which a number of foliow-upL studies have addressed include: 

o Dc^fine the extent to which forr^er vocational 
students have used their vocational training. 



I o Identify types of ©n^loyment ©xperiences which 

; former vocational students hav© had in the labor 

market. 

Q 13etermine occupational, and geographic mobility 
patterns of former vocational education students-. 

o Identify reasons for former vocational students 
leaving before completing a program of' studies. 

o Identify on-the-jdb. difficulties which former 
students have experienced. 

o Determine the adequacy of training from the per- 
ceptions of" former students. 

o Obtain information' on the extent of participation 
in postsecondary or continuing education training 
oppoiftunities by the former students. 

4 

o Define ways in which programs can be .of additional 
assistance to the former students toward improving 
t^ie .transition from school to work. 

Other exemplary objectives which can assist in defining 
. specific questions to be used in developing a follow-up 
instrument include: . 

o Provide job placement and job competency informa- 
tion indicating needed curriculum, modifications. 

« 

o Provide job satisfaction indices and job skill 

information useful in evaluatirg vocatior^l educa- 
tion instructional methods and procedures. 

o Provide descriptive information about various 
jobs useful in guiding students into training 
programs comp"atible with their interests and 
abilities. 

o Provide job training information which suggests 
instructional staff retraining, expansion, or 
reassignment. 

o Provide information about skill training re- 

, quiring new or additional equinnent and f-acilities. 

o Provide information necessary in ' determining the 
cost-benefit of the vocational education program. 
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Provide information useful in evaluating the ef- 
fectiveness of th© vocational guidance progtam and 
in measuring the demand for a special needs 
program. 46 



♦More specific program obj^&tives emanate from- broadly w 
based goals and objectives. If v objectives are stated in 
performance terms, they can be the basis for stating criterion 
questions and consequently, questions to be includes in 
the follow=up questionnaires. Consider, for example, the 
following outline of the process in which follow-up questions 
are derived t^pm the 1976 Vocational Education Federal 
Regulations. Specifically, the regulations provided for 
the federal grants to states to assist them in addressing 
a number of broadly defined objectives, one of which was: 
."To extend, improve, and wheris necessary, maintain existing 
programs of vocat ion al. education. " From this broadly' 
defined objective a program objective can be derived, 
criterion questions developed/ and items for a follow-up 
questionnaire developed. The following checkli'st presents 
three broadly define,d objectives to consider in planning 
the follow-up study. 

« s 

Ik 

Checklist for Defining the Follow*up Study Objectives 



What is (are) the broad objectivels) of your follow-up study? 



Ranl< Order of 
Importance 



1. Improvement^i^xpansion of vocational education 
programs for special populations. 



2. Assistance in decision making. 

3. Assistance in planning. 

4. Assistance in evaluation and accountability. ^ 

5. Other: 



Hamilton, et al. offer a systematic approach for. 
develoDina follow-up questions as previously described, 
figure 5-5 illustrates the sequence for developina specific 
'follow-up questions. 
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A SyttMHrtle Prooin f6ri)eytlopfng 
a Followmp Qtiastionnaire 



Program Obieetive: 

. To providi acsddmicdlly disadvantaged students with an educations! program which will 
result in their entering a career program that is satisfactory to them. 

A Criterion Question: 

How well do former vocational students feel their education program prepared 
them for an occupation? • 

Kerns for the Questionnaire: 

1 . Considering your occupational experiences since leaving school, how well do you 
feel your school prepared you for'your career? . 

Superior preparation 

Good oreparation 

Avera^ preparation ' ^"^ 

Poor preparation . • 

No preparation 



2. How do you feel about your current job? 

* 

I am very satisfied 



f 



' 1 



I am satisfied 

I am dissatisfied 

I am dissatisfied o ' 
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f mat ^levant' quest iens shoaia -be ask©4 ©f ioit&sP ' 
studQRfes -and their ©mployer^? As dis^ysse^earlie?', ba© 
must review the fellew-up study obj©etiv©sV ities^ ©feje^tivQS 
8ho,uia^<tbfleat the intent ©f f@a©ifal le^risliotion, th© goals 
©f th® Stat© plan, and. the goals and obj©<3^iv©8 of the 
loeal edugati.on afenqy.^ Prom the review of' thos©. goals and 

•obiQ^ivee , Jeate^or^s of^ data or lnfoinnati<m can b© 
idpntifieti The. rop* frequently , -used" dtfta categories ' 
inelud©.: •employmenl' data, ©valtfativf} data of training and 
related servieea (both th© survey o£^h© 'Employer and 
fortm^ student are equally impertant) *^ eoniihuing ©duca- : • 
tion^.plans or ©X|©r4<^nc#8 since leaving •IscR'ool, and jofe 

viatj^faetioiv. E|gur© 5-6 offers a %ypiM^©©t that will - 
¥^ «in systein^tieally relatift^ the goals .or objectives 

*to ^I^Mata or infc*raation and questions ^o^b^ aske'd. 

Vj Fqrmer student surv ey. Eni'nger'* identifies thcge. brcfad ' 
•daTba eategories used for»the purpoBe of developing ^liestions 
for gathering inforri^io^ on former vocational students i 
(1) odcupatioh'al \hi^tory since graduation, ?( 2) educational ' 
history since graduation; and (3) present interests., 
activities and affiliations. 48 *• - w 

• [ '■ « • ' ' . 

Jirst, Enj^g^r s>agg4?tV-that >qecupational.his'tory can 
bf addressed '-With' -que»ti%is focusfnl 6n ten items i 

. o General jo^^p^^bemerit : /How soon after graduation-^ 
was the gradit^te emploi^d? ' ' ' . . 

o Related job bla«eiWbs ,How quickly did he/she rdnd* 
employment i'n a fielS' related to,her/hi& training? 

o Employment Security: How much of his/her podt- 
graduation employable time :4as she/he spent 
in full-time employment? . v 

i 

■'o Job stability! How many different employers has 
^ he/she worked for during his/her employment period? 

o Job satisfaction J How satisfied has she/he been ' 
with the jobs held> during her/his' employment period? 

o Job relatednesss To what extent have t^e job^ 

he/she has htild been related to his/her high school 
vocational training? 
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FotlowHip paWQuostlennafriB Workthoet 



J 



Lilt l^ram Ol^eetlve 

To provide visually harali- 
eappfd students with'a 
vocational program which 
« will prepare them for o 
. career that is'sitisfaetory 
to them. • ^ 



Idanti'fy DataTyi^ 

• Employment data 

• Evaluative data ojl ■ 
training 

• Continuing edM^tion 
plan 



Quoftions 



What is the title 

of your current Job? ' 

How well do you leel 
' you were prepared toi* 
this job? : ' 



qn 



if 



( 



Initial earnings J l^af w©r© h^?/hi© initial 
©arninfs ©n tha fi^gt full time j©b? ' - 

Present Qarninfsj what ar© his/her present » 
&am,ing8 fiy@ yoa^s after graduation? ' 

. V-. * 

Earnin'gs preg r©ssien t ' Hew have, her/hife earnings 
increased ever th@ total' eropl^^^n^t period? * ^ 

J«b ^mobility! How often and how far had h^/she 
moved to improve eiaployment' st'attis? 49 . 

• • ■ " \ 

Questions in th© seeond eategory deal with the forner 
voeational student is postsecondary education and training 
@xp©ri©Ae©8 and future plans in^th^se ar@a%, ' ^ 

Th6 third eeetion focuses on the. vocational student's 
conversational interests, leisure-time activities, organiza- 
tional affiliations, and attitudes toward school. The , 
latter reflect on such services as guidance, counseling, • 
^^d job placement, (which may or may not have been provided), 
and the adequacy of the vocational program and overall 
curriculum. . - 

i!mployer a^Aryey. Th^.aame guidelines for preparing 
a questionnaire for. follow-iip of former vocational students 
apply for employers. The dpromon data. collection procedures 
for bbfainihg follow-up information on former stude^^ts from 
th© employer using a mail survey include 1 

1. Employer responds to a mail survey which includes 
a list of guestioRS or a request for a, summary 
statement about the former vocational students as 

. ^ employees. • . ' ; 

2, Employter responds to a mail questionnaire con- ^ 
cerning an 4'^di vidua! employee who has had voca- 
tional education, trs^ining-. ' f 

Questions which are commoRly asked of. employer^' includes 



r 



How many persons do you employ^ ajid ^ow many- #ire 
former vocational students? 

What jobs «ao former vocational students enter" 
in your company? 



'I ♦ 



How satisfied are you with the performance of 
vocational program graduates? 



■• ■■• ■-. (■ • . ,.• . • • 

o l^hai aj;@ particularly strong dnd/or maVi^ 
e areas in ||ho fo^jn^^oqatibnal studei)t*8 training?'* , 

• o Hdw do you compare former vocational ^ e^uoatio^ 
« stude&j^s w4th Ron-VQc^tional students on job. ^ 

entry skills and job or peeupat^nal mobility? v,' 

o l^at msthod or job placement service was us'ed^ - 
, help employ the former vocational students^ Were 
you satisfied with this service? 

p Do you have a workiiig relationship with the ' . 
school placonent service or individual ibhool 
' personnel?' Has this been satisfactory? What are ,^ 
the ilarficularly strong points and/or weak points ' 
of thi^ placement service effort;? 

■-'ft is recqtoAended thw'the data from employers be €Cnalyzed 
by individuaJ^^rogram' ai^^ and on an individual student ' 
;basis. Also, the data shdaid be ^^viewed and compared, with . 
the indLy^dual stUdeb^t foMow-up data. Examples of employet 
fbllbw«-^/^t^stioimaires ajSe found in. Appendix A. \, 

Commonly accepted rviles for questionnaire construction . ' 
Th^nre are 'certain b^k^ici'^ rules for constructing a follow-up 
questionnaire. Ebel suggests the followjUg guidelines which 
can be applied. for follow-up questionnaire designi ? ' >, , 

1. Express each item clearly. • . . ^. T *• 



2. 'Choose words that have precise '.meanings. 



3. .Avoid coi{(plex or awkward word arrangj^ments; 



4. Include all qualifications needed to provide ia ^ 
reasonable basis for Response selec€ion. 

5. Avoid the inclusion of nonfunctionaj.' words in the . 

6. Avoid unessential specificity, in th^^question o4 
in the response. 



i> Jf. Avoid the inclusion of trivial questi 

/ 



•8. Make the suggested ^j^nswers simple 



Lvial questions, 
id i^answers simole. N 



9. Be- sur^ .the items will be seen by the respondents 

as applying to a concrete situation. ' ,<> 



' io\ Kef rain fr^ asking questions ©f opinion unless 
• ©pinion is what is s|^eifically required^ 

11. Avoid Itoffs that are too augeostive or too un- 

.. stimulating. They shoul.d n©t l©ad a rfesponden^ 
to go beyond the facts;- bu€ thoy should indue© her/ 
' him to provide tho required information. 

12. Phras© ^^lestions t© avodd the acad©micaa,ly or 
socially accepta&l© responses. Make it possible 
for the respondent to answer truthfully without 
embarras^nt. ^ 

13. Avoid questions that may be checfeid with several 
« responses. vwhen only one response is desired^ In 

'■ fact, such items' usually are quite difficult to 

tabulate and analyze. 

^. Whenever possibll, -word, questions so that they 
.can be ahswered simply by a check mark. 

15. Ask questions in such' a way that oomplex thinking 
Toy the- respondent Will be'minimal. A popular 
technique, is to reduce .,a complex question to a 
series of questions which are easier to Answer. 

» • , ■ • ' . 

16. 'Avoid the•^^se of words which are susceptible to 
different? interpretations-; e.cr. , moral or immoral, 
good or bad, rich or poor, ihtelliaent or ignorant, 
laborer or capitalist. 51 . ' 

V gymat considerations . Data processing i« a primary 
coAi^ideration in ^developing a formkt suitable for a follow- 

questionnaire. Whether processing data manually or by 
eiec^tronic data processing equipment, certain time and cost 
factors must be considered. Serious ajbtention' should be 
given. to developing a format capable of being processed by 
S9me ej^e'dtronic data processing device. 

• The types ,<of questions asked and structure of the 
^ questions. 6an Restrict coding and analysis procedures. 
« Open-ended, questions are much more difficult to process with' 

electronic data processihg equipment than are forced-choice 
» questions.. For example, a typical forced-cho^ice question 

found in a- follow-up questionnaire would be: 



4 
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Sow dees, ymur resent job i^elif^te to y^ur tVainin? 
received at the area vocational isohopl? * 

1. ' Highly related ^ 

2. Somewhat relate 

3. Unrelatetd -s.* « 

An example of an open-ended question commonly asked' 
a follow-up of former vocational students, and one which 
Id create problems should the for<m b& procesded using • 
dleetrpnic data processing equipment, follows s 




Oe^orib^ your specific job dut;|.ess' 

' ' ' > f 



:t is extremely important that one worle withsa compr^iter 
systi^md ,analyst||or person in charge-of data processing to 
revip8w^tt^e> 'questions and data needs in order to design a 
questionnaire ^hich is both cost effective and< efficient. 

* » ' * 

^8C!i^ipt:l$k)s of exemplary survey instruments are pro- 
vided %4jl»idbobk currently availe^l^ . for use by selected 
s^ate v@€at;|.onal ed\;^tion agencies and secofidasy and post- 
secondary dchopls,. Vocatiional Education Measures 8 Instru- 
ments to Survey Former students and Their Employees . The 
handbook focuees on four types of instruments t "i * . 

1» Job Satisfaction . . instruments which have items that- 
are purported to measure employees * perceptions of . 
their ^satisfaction with co'i roonents of this job 
(e.g., pay promotions,^ supervision, co-wprkei's,' 
and work) ; land instruments, in which |the suiji of the 
scores across components yields an .overall job \ . 
satisfaction measure. (Instruments* which only * 
have questions to measure^ overall job satisfaction 
♦ were not included.) '\ * 

2. Job Performance . Instrun^ents which have itemi 

that are purported to 'measure employees* performance 
in the various dimensions/components of employment 
(e.g., knowledge, skills, attitudes, and work 
attendance) as perceived by the employer. ^-(Instru- 
ments which only have questions to measure overall 
employ^ performance were not included.) 



The reader 'is encouraged to review this publication for 
ideag j£or developing questions appropriate for inclusion 
in a follow-up study of former vi^cational students. These 
questions can be adopted or adapted to px^ovide follow-up 
data on special populations. The full citation for the 
document is^ Keriney Gray, >larie Abram and Floyd McKinney, 
Vocational Education Measures: ' Instruments Used to Survey 
Fotmer Students and Their Employers (Columbus, Ohio: fKe , 
National .Center fov Research in Vocational Education,' 1978) . 
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3: Porn^g S tttdenta* Pe'roeptipns of Training » Ift- 
.strmnenis which have items that are- purported tp 
ineasu^e for«ip.r students* peroepkions. o£ the. ' 
adequacy* of o<Mgnponenta of their training -program 
(@ * » I f aci litles and equipment^ competencies 
acquired, i*and pXacemBsn^ services) , ' (Instruments 
which only 'have questions qn the overall adequacy 
of the training p^rams, were not included.) 

^r/ ^^g^®"* PereeptAona ^ Training . Instruments 
Which have items that are purportcfd to rooasur& the 
. ef fe^ctivenesd of components of employees' prepara- 
tion a^d tr^ning for employment (e.g., )cnowledg6 
and . skill ^^a.^) as perceived hiy an employer of 
persons who recentlj^completeS^a job training program 
f (Instruments Which only have qlestions to measure 
overall adequacy of preparation and training 
programs were not included.) . 

« * • 



Appfaranee 'of the Questionhftire 

♦ A questionnaire must be visually pleasing 'and simple 
in contend:. *€ruestions should need no clarification; that 

respondents 'should not have to ponder over the response 
being requested. Many suggest that the first seri-es of * 
questions are extremely important in gaining rapport with 
tbe respondent. -It is in^ortarit to achieve a favorable 
attitud^/ oa. the part of the respondent toward the follow- * 
up study. Questions which are easiest to answer should be 
placed near^the beginning. Those requiring long-term recall 
or those of 'a personal And evalUa^ve nature should be 
placed at the end. Favorable ' attlSudes-may:be- enhanced 
by deye loping a sequehce of questions that conform as 
nearly as possible tp the resppndent^s way of thinking. . - 
Additionefl 'suggestions for developing rapport with a 
respondent include.: 

, ^o Arranging ideaS' in a questionnaire according 

]bo a logical sequence. ' ^ ; 

, . d Developing the first 'question to motivate the * 
* respondent to participate. 

T,ravers suggests that early questions in a series be 
constructed so the accuracy of subsequent responses can 
be , checked. 52 por example, if you are trying 'to collect 
total income information, you should ask for information ' 
about the- place of employment — name, type of industry, 
job title, job duties, hourly or base pay, and hours worked 
per week — before asking for total income. 
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^Pl^h@n8iv@ and unified picture/ of ^ho whole purpose of 
Kfbllot^up. It is highly reo^iended that divisions b@ 
d@v@Iop@d within th@ questionnaire. Specific sections # 
such as employment inf drmation « continuing education ex* 
f ' -^*. periencQs, 'ffb satisf lection, education fr training assess- 
L ^ mn^, ©to. ; could be used. \ h 



9 



V . ^ wj./ ^ rs*. 



^ * • The graphic appearance of the instvuxnent is very 

important. Research has shown the response rate of a 
, . questionjaaife which is mimeographed on white paper will 



' «b@ i lowe^ '-thjii the response rate of one which , is ^ printed' 
onlareen ^ap©r.54 ^ ' 

lai^y edti,cational researchers^ agreef that more returns 
.wj^rbe received when. guestionni^re fofms are effectively- 
'l^^g^ented ai^d easy to^read and complete. Suggestions 
..include: , * . ' . . 

o Use high quality » paper . *" ' 



o '^^'coloifed paper or colored ink. 

o .Print the form rather t^an mimeograph it 



While- most agree th&lf "^he' q\iestionnaire must be . 

, .attractive, a few questi^ the lieed fpr having the questfon- 
haire printed, unless spacing problems are better met by 
printing. 55 a very basic rule to follow in designing the 
questionnaire is to allow adequate ^pace for answers, 

4. particularly for open-ended responses. Failure to do so 
discourages respondents* from. answering, reduces the 

^opportunity for developing rapport with respor^dents, and . 
makes. interpretatj.on of responses difficult. , ^ 

\ • • • ' " . 

. Some individuals have jised personalizing techniqj^es, 

such as handwritten letter^ or follow-up forms included*^ 

'With a birthday card or Christmas card, 'which have the^' 

effect of increasing the numb.ern' of responses. However, 

there is some evidence to indicate that personalizing the 

follow-up produces, only slight gains in the quantity of 

replies and none in the quality. 56 

General requirements in the design and printing- of the 
questionnaire include: . S . 

o Title of the study should be d i splayed neeh: the 
top of the first page of the question^iaire, 
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' o Name of the sponsoring agency should* be center©^ 
^ at th© top of the first page of the qi^s'tiortnaire, 

,0 . Space for the respondent's name and title shbuid 
be provided. It is strongly recoiionended that a , ' 
questionnaire title be included on ^ emoloyeV 

i fo-llow-up form. 



« o 



Mailing data of the questionnaire should apbear 
on page onq, 

o 'Nam^, title, and complete,, address o* person to whom' 
the form should be returned should be .included on . 
- the first page, possible. Otherwise, it should ^ ' 
be ehtered as the list item on the form, 57 

Another suggestion ^in regayd to the graphic design of 
the^ questionnaire is the lisef of /pre-numbering scMme for ' 
forms. Use of numbered questioilnaires was recommended' 
for two reasonsi (1) if the re^^bndent fail^sr to write his. 
name on the questionnaire, an atjcwrate record of the returnee" 
uestionnaires is maintained; ahd C2) numbered questionnaires 
te useful in tabulation of information. Also, the code > 
number can be used to identify respondent groups, such as 

^^^^ eliminates^ the idei^tification 
of in<y.viduals if there is a need id read iiidiyidual«^ep6rts,58 

Questionnaires should also include, "a brief statement of ' 
th% purpose of the study in an accompanying letter. This 
letter should be endorsed by a person whom the respondents 
Know and respect. Examples of questionnaires and ac- . , 
company ing letters whifch meet the above requirements are 
found in Appendices A through E, The following check- 
list identifiers critical factors in developing a follow-^ 
up questionnaire. * . 

Sex. and Ethnic Stereotyping Consideration s 
for Follow-up Studies 7 

■ * • " . 

Vocational educators must be concerned with the need 
for eliminating sex and ^thnie stereotyping so, that all 
individuals can pursue training in those careers which they 
desire. Therefore,- it is important that curriculum material, 
classroom discussion, written documents and corresponderice , 
and test and measurement devices be free' of such stereo- 
typing. This section of the handbook draws upon accepted 
guidelines which have been designed to assist in the 
elimination of sex jmd ethnic stereotyping in the designing 
and planning of follow-up studies. 



-89- 



In Oi«^topiit8 tiio PoiloiRNip QiMitloniiaira 



^1 



V 



Does your foitow-Up questionnaire inclucfe the followtno? 



Yes No Cbn^pi / * * *. 

^ 1< The finftsctries of questions gain rapport wt^ the respof^ent. 

.2. Ideas are seqi«ncfidaecordlng to the logic of 'the rlsppndent. 

3. ^iy questions In a series are constructed so that tN accuracy 
of subsequer^t responsestcan be checked. ^ ^\ 

4. Questions thpt may be answered in a similar faiiiion are grouped 
together. L * . . 

Apiaearance • . * ^ ». * 

5*. .The questionnaire is reproduced on high quality paper. 

' \ •* ■ 

6t Colored paper or colored ink Is usM to Improve the question- 
naire's visual appearand. 

■ • ■■■ ' • • 

7. » The questionnaire is printed rather than mimeographed. 

•'■ ■ ' ■ ■ * ' . y.-^- 

Format 

8. The title of the study is displayed near th^ top of the first page. 

9. The nanrte of the sponsoring agency Is centered' at the tqp of 
. the firet page. 

10. Name, title, and^edmplete address of person to yvHom the form 
should be returned is included on the first p^. . ^ 

1 1 . Space is provided for the respondent's name arv< title. • ^ 
t2. ^Questionnaires are pre-numbered. ' / 

'fhe purpose of the study is included in an a^ompanyin^ letter. 
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pr actical guidelines tok reduc ing I'tter^o ty ping. ^Etfotte 
sheula b® maae to eliminate sex ^nci Wthnib' stereotyping when', 
constructing questionnaire® ai^i'd intervi@w guides. Certain 
guid©lin@fe and practicee can' 1?©. helpful . A major portion of 
th@ following information has been paraphrased ftoro a publi-- 
cation of the National Advisory Council bn Woman's Progr^s,^ 
These guidelines are intended as a learning tool to assist 
you in. reducing sex fiyid ethnic stereotj^ping,- The « following 
statements should be. considered; ' 

. » 

o Use language that encompasses both sexe^'s she/hs» 
her/his? nongender referents, such as you, they, 
individuals, person; restrict use of persooal. 

, . pronoun^ by substituting, with articles such ad 

a", an, the. ' .•>*,' 

*. * o ' Interchange the use of men and women , he ands she a 
with women and men, she and he. T 

o - 'Use neutral terms in identifying occupations 
or describing labor market factors. Examples 
. include: firefighter, fpr fireman, human resourced 
for manpower, businesspersQn for businessman, etc. 

o In developing questionnaire items; use names thait „ 
are different from a white, rt^iddle- class orienta- 
tion. Names common in some ethnic or minority 
groups i'Vicludex Mohammed, Pedro, Shos'hauna, " * " 
Bogdan, Seon, Yett'a, etc. ♦ - ^ 

■ ♦ « 

o Use items or que#tj.ons that - represent a vas^iety 
■ of life ^yles, socioeconomic .levels, handicaps, 
etc. 

•o Consider language, both oral and written, w>^%ch 
depicts males and females , '4n.non tradition ' 
•occupational roles.. . * • , 

Stereotypical vocational role .expectations for those 
of certain 'ethnic origins and sexes Jiave become a major 
' concern of our^ Society. The individlial (s) rfesponp^ible for 
' follow-up studies must be sensitive to these societal 
^concerAs. B^y using language which -is attentive to re- 
' 'ducing sex -and ethnic stereotyping, vocational educators 
are broadening the awareness of the World of work for all 
concerned. .^^ ' 
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^M^jor ©onsiderations ar© idef^tifipd in the checklist 
.foe,- defining @qh and >thnic stereotyping language in th@ 
follDW'up quest ionnair^i or- intor/iew quid©, ^ ^ ^ 

' Ghadclitt for Oafitilnfl^ and ethnic 
\ S«wwtyRlnfiLansu^lntfteQii«ttonnalr8 



Jf^"r ^^"PW'^'P instrument ellrrtlnate sex and ethniistereotypina 
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" \\ interchanging the of men and women, he and she with 
w^men and men, she and he. 

• • \ ■ • - ■' ' 

• 2. Using neutral terms In Identifying occupitions or dbscrlblng 
labor markets. - ^ ^ 

3. ^ g names that are dlf^nt from a white, middld-class 
» .01 jntatlqn. 

4. Uslngltemsthatreprwentavarlety of life styles, socio- ^ 
, economic levels, hfilndJcaps, etc. 

5. Using language which depicts males and f&ales In non- 
traditional occupatlpnal Voles. 

For more detailed infopnation , \:he following documents 
are recommeaded for assistance in addressing the stereo- 
typing concerns: ^ .\ - . 

^ Sexism ^ and Language . (Nilsen/ et al/ 1977) 

. o Guidelines to Insure 'Sex Ffgmess in gducation 
Pi vision Communications and Product!^ ^ Women 
on Words and ImagfeSf Inci , 1^76) 

« 

.° Job Title Revisions to Eliminate gex, and Age 
. • Refer ent Language .from the Dictionary of Occu pa- 
'tional Titles . (U. s. Department of La^nr, \%^\) 

o Guidelines foi: Creating Positive Sexual and ° 
R acial, .Im ages i n Educationa l Materials. 
iRoberts; 1975) ^ — 

o- Racism in American Education; A >l6del for Change . 
(Sedlacek; William E. and Glenwood'c. Brooks. 
• 1976) , . . 



o gugair ^ g^Sgice i'6 not the 'Answer t A' Parent 

lie 
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Hanjalboolc on the" Career Implications of ^©x" ^ 
' Stgr @otyplneK (Vetteg, L,; C. M. Lowty& C. Burkhard^ 



o ' Gui dleline4^ for Sex-Faifr Vocatioi^al TOSSIition 
Materials . (U. S.. Off ice of Education, Bureau 
o,f Occupational .and Adult Education, 1978) ' 
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Developing >ol t!p Queftions . 

for V0^tional' Education Programs j \ - • " 

A 6oramonly used questionnaire fpr follow-up of former ' 
vocational students adopted by most state and lp6al educa- . 
tion agencies .consists of; general fetatus -questions. These 
questions l^ave been categ^orized a'fe:. 

{ 

• 1. Personal!' information - includes information on 
sex, ethnic background, age, etc. ' . 

2. Employment information - defines whether the 
individual is emt)loyed or unemployed, and for 
what period of time. 

> . » 

3. ° Job Information ^- ih eludes information on place 

of employment, job tijtle, job duties, wage or 
salary. . ^ 

. »• ■ • ' . • . ■ 

4. Curric^ulum information - defines ^whether courses 
taken in school supported or assisted tKe individual 
in doing her/his job. * 

ft 5. School and community services dnfo-rmation - 

identifies who assisted and what assistance was 
provided; the j individual in finding employment. 



ContiriiUjig 'education - answers 'questions , such 
as: Dijjl the individual, continue her/his Schooling? 
If * SQ<^ in what area? Was it related or' unrelated 
to a(revious' tralfl^ng? ^'^^^^ . • 

/ Information, obtained by asking questiofv^^j^ich relate 
categories is viewed by many local educators as 
^nfoiw^tion which lacks the necessary detail to meet their 
individual program needs. Often, .individual teachers have 
conducted their -^own fotlow-up studies of their program 



graduates, to obtain what th©y consider £b be their real data 
needs. R^eognizing that each local educator may need addi- 
tional aad/or different information from her/his former stu- 
dents^ a niimber of statewide centralized follow-up systems 
have .provided optidrts wherejay the local education agency and 
an individual program area teacher may -add questions to a 
foliow-up form to obtain neetjed detailed information. Some 
state systems have prpvided 'this option for local education 
agencies. ^ 

The "program object;ives and cojnpetency-based objectives 
of the^ individual vocational education program areas can be 
translated interspecific questioi\s for the follow-up form. 
The prpcedures as outlined earlier^provide those basic steps. 
Another consideration would be''^ define th^ questions around 
outcome categories. ^ ' 

« • 

In^ formulating individual program questions it might be 
helpful -to. consider the individual student and 'program 
outtforaes. These outcomes can be defined as immediate 
student outcomes, long-term student outcomes^ and intended 
progr«im outcomes. Definitions for these outcomes follow;* 

• . * ■ , 

o Immediate studertt outcomes : Questions about 

changes in students' knowledge, s^cills, attitudes, 
or behaviors resulting ^rom an • individual program, 
^area experience^ le .g. ,• define skills neejded to 
do the job, positive attitude about work, etc.). 

o ' Long-term student outcomes : Questions aboiit the 
impact of a program area on the students ' career 
development after leaving school (e.g., job 
satisfaction, mobility, etc.). 



'- V ' . . ' ^ ' 

♦Adapted from: K.- A; Adams and J. Walker, 1977. ^ Improving 

the Accountability of Career Education Programs: Evaluation 

Guidelines and Checklist , Draft Copy (Columbus, Ohio: 
The Center for Vocational Education, The Ohio State Univer- 
sity) , p. 37. r 

/ 
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o Intended progg^ butqomeB j . These are questions'''' 
/ about changes the. brogram is de«igne^ to brX^g 
about that, are broader than individual student , 
outcomes (e.g., increased community^ involvement, 
increased understanding of work *thic, awareness- 
of stereotyping by sex and ethnld r6l,e^ etc. ) 

A list of hypothesized vocational ediJcatiojf Outcoitie 
statements (general) are offered ii^ Pigiire 5-^ to provide 
a basis for formulating special., population outcome ques- 
tions and follow-up questions. )* 



Improving the Readability of a Follow-up Ijistrument 



Good defines readability as "the quality of a piece 
of reading matter that makes it ;lntere8^iho 'and under- 
standable to those for whom it is written, ^it whatever . * 
level of educational experience ."60 , " 

' Analy&is of Good's definition is necegsa^^. It is 
assumed the content of a follow-up instrument fulfills 
the definition's critej?ion of "a piece of reading matter." 
It is also assumed in order' to achieve acceptable response 
rat^s (a prerequisite to fulfilling follow-up study 
objectives) r-- the instrument must be "interesting.". However, ' 
^bd's definition does not;assume that the reader will not . 
h^ve the same reiaponse to an evaluation instrumentf that she/he 
wQtild have to more*casua;L reading, e.g7, comics of weekly 
.magazine. Speci'fic , attempts to make ^e follow-up > itistrument 
"interesting" are dealt with in otherfstfctions .of this, 
handbook. This section deals mainly ^i^h making the follow- 
up instrument "understandable to. those fot whom it* is 
written, at whatever level of educational experience." ' 

There are a variety ©f factors. which help determine 
^whether or not reafding matter is undetstaiidaBle. .. Some of 
these factors — interest and intelligence, for example — are 
internal human factors that tjie designer of a- follow-up 
instrument cannot address. Other f actors--wold or sentence ' 
length, for example— are' important considerations for the 
instrument designer. In order to determine if reading matter 
is understandable to the reader, it Is essential to judge 
the difficulty of the material. OncJe the difficulty of the 
instrument has been determirje^^ .and /compared to the educa- 
tional level of the targeted'jiudiehce, charges and nvodifica- 
tions, i^ needed, can be ihade^in the instrument. 



* » 
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HyiMthefindVareatiORat Education Oi&meStatsments ^ - 



' High school seniors enrolled in vocational prograrns are more satisfied With their school expe- 
riencethan are .comparable^tudentitaking acadeniic/genefal courses. 

* *. ' \ ' ' ' • 

Employers i^ate \focation^ students more satisfactory .as employees than comparably academic/ 
genlral Sudanis after six inorvths on the'Jofo. , ■ ^. 

" { ' * * 

Within six months 6i^p>ogram con>i>l$tion, students obtained Jobs related to their occupational 
training. ' ! * * ^ < * 

High school ^rdpout rates are°io^ei^for vocational students than ^for ({om parable students* 
enrolled in academic/general cCirricuia. 1^ 

Two ye^arsaftef^fiogram completion) vocatii^nal student^ were more satisfied with their Jobs 
than wefe graduates of ii^emic/general programs holding^similar Jobs. 

Parents of high sc^l seniors enrolled in vocational programs are more satisfied with the cur- 
.riculun\than a're parents of comparable students enrolled In academic/general progran;^8. 

^thin.six months of program completion, studer^ts obtained satisfactory Jobs, though not 
necessarily in the are^f th^r occupational training. - 

Upon completion of a vpcational program, students were certif ied as bcbupationaify pro- 
ficient and ready fpr er^ffy-levei employment. V ' «• ' , 

Private sector employers rate high school vocatib(jat programs in their communities highsj^ , 

than academic/general programs. , 

' \ ' . • 

One year after program completion, vocational students were earning higher hourly 
than coniparable academic/general students holding similar jobs. ' 




< 



\ 
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There are two general methods of judging the difficulty 
of written materials:, ^f ormal' an*^ formislt * The informal 
method is easier but yie^ld's subjective/ less 'reliable data. 
The formal method uti|.izef ..tes^ted readability formulae to '. 
assess written materials %d obtain the approxilhate grad^ 
level score for, the materials. Each of thes^ two methods' 
will be discussed in the following subsetjtioris . One point 
worth reitlembering' i« that iajrl follow-up instrument designers 
should conduct both infompil and formal prbcedures also. 
'.The additional expense of floin^ both is minimal, with the 
major trade-off being increased development time. 

' informal technique (pilot test) . The informal technique 
for .iudging th.e ^dif f iculty of a follow-up instrument is to . 
conduct a pilot test. A group of students representative 
of the target audience can be located or "recruited" tp 
complete the first da^ft of art injstrument. Sons, daughters, 
nephews, nieces, or neighbors, who are or were vocational 
students may. Be easy to recruit for such a pilot test. 
However, the instrument designer needs to be cpgnizant of 
the representativeness of members of the group. Foif example 
if the target au^^ience includes early leavers and dropouts 
from a vocational program, it is ,imperatiy§ fep locate 'such 
student? to h^lp pilot test Ihe dx^aft ilistruSint. 

TWO. commpn procedures .^re* used to pilot test the first 
drdft of a vocational follow-up instrument." The flr^t ari6h 
•easier' is to distribute the instrument to members the 
pilot test group with instructioas to make notes, *commen'ts , 
and remarks^ cgi any content, clarity, or reading problems' 
they may, encounter while qompleting the instrument at 
-their.' leis.ure.. The second and mor^ difficult procedure is 
to interview members of the pilot test group after they have 
completed the instrument. A designated individual should 1 
keep notes during the interview process to record words, 1 
sections, questions, and other itiems that should be revfs'dd' 
in the *fol.low-up instrument. I \ , 

• • By utilizing the first pro'cedure , the designer minimizes 
possible peer pressures on items of concern ana probably 
obtains divergent points of yiew. Utilizing the second 
tactic, however, allows for 'discussion of -disputed points' 
or items and may lelad to an improvement at that time. A'' 
third — combination — tactic may be employed. ' Here the 
designer. may hand carry or mail the draft instrument and 
.obtain the responses with a follow-up telephone call. This 
w4.11 save, some time. Whichever procedure is used, re- 
spondent a ,should be asked to record the exact amount of time 
requife'd to complete the instrum^ts these data are needed 
by -the follow-up instrument developer;- 



There are several i'mpprtant reasons for subjecting 
all follow-up' instruments to the informal (pilot" test) 
technique for determining the difficulty of written material! 
One reason -is that the pilot test of a- draft instrument 
yields, -crucial respondent data that help identify areas 
that the -follow-up ins*truroent designer shduld improve. . 
The pilot test data reveal: (1) lengtJB of- time required to' 
coB)|Jlete the instrument, (2) reaction^to the ^-esponse imode (s) . 
(3) Nclarity of ;th? dire<!tions, (4) possible misinterpfeeta- 
tionsNof words with multiple meanings-, and! (5) jargon or 
slang terms that created problems for th^ respondents. 

i^other reason fbr pilot testing all draft versions of 
follov?-up instrumeh^^ is to jtidge th6 difficulty' of written 
ma^ri\als that readability formulae do not consider. Some 
subtle yactot>e not consideired by readability formulae include 
the com^^jexitf ot the concepts, the level of abstraction, 
the writeMs^tyle;, and the grammar and syntax of the 
passage. C&her. less sul5^3>e factors not considered by 
readability, formulae include the kind df paper, the color t 
of the paper, tlife type of pHnt, the size of the print,* • 
artd even the color of €he ink used in printing. 

Formal, .lechnique (rjsadability formula) . «stf of a 
readability formula yields an approximate gradfe level 
score- for. the written materials analyzed » The important 
adyajitage of using readability formulae is that they have 
been developed through research and thus yield more reliable 
data^'than infornfal pilot test techniques. 

Most current readability, formulae consi'dei* two character- 
istics of V written materials.- First,, they assess the 
difficulty of words printed in the sections of the written 
maf:erials under study. This is important because the more, 
unusual or long words the section contains, the more 
difficult that section is likely to be.* Second, readability 
formulae determine sentence' length in* the section und^r 
scrutiny. This characteristic. Is important beca\ise the 
Iqnger and more" complex the sentences in a section are, the . 
more difficult the selection is likely to be. Readability 
formulae manipulate various aspects of word difficulty- and 
sentence length characteristics to arrive at their ap- 
pri^ximate grade level sbdres. 

There are four popular readability formulae applicable 
to follow-up iifstrumene use. >The Pry readability formula 
Uses the criteria of syllables per 100 'words and sentences 
per 100 words in determining . its grade level score. ^1 The 
Flesch readability formula utilizes the criteria of words 
per sentence and syllables per 100 words. 62 -jhe Dale-Chall 
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formula emi^loys average sentence length and the percentage 
of unfamiliar words as its cxiiical criteria. 63 The SMOG 
formula uses word length and iiumber of ' polysyllabic words , 
as its criteria. 64 All formulae are accurate within one 
grade level for -their scores. Each of these formulae "is. 
explained in detail in refei^ences listed in 'this section. 

Readabi,lity formulae typica^lly i^nstruct the user to V 
select one or more 100 -^word' passages in which to derive 
necessary components. For use with a follow-up instrument; 
these 100-word passages y^. 11 probably *need to be secured 
by grouping and clustering the ins^r\iment ' s sequential ^ 
questions and responses, iibwever, the» apptoximate grade 
level designation obtained foi^ any one particular 100-word 
passage may 'not be representative of the entire foll<ow- » 
up instrument. Thus, the designer should take a number 
of 100-word selections throughout th^ ini^trument ir\ Order 
to obtain the reading dij^iculty of the whole, instrument. . ^ ' 

^ A hypothfjtical jkppj^cation of £h^ Pry readability 
formula to a vocatseital follow-i^) instrument is presented ^ 
below, ^he user is instructed te pick a <lninimum of three 
100-word selections from the written m&^^SPll and count the 
number of sentences per 100 words and the number of syl- ' 
lables {^er 100 words. Suppo^ the results of this step wer^ 




\ 



Passage 



• 1. 
2 



^o.' of Sen.tentiea 
Per 100 Words 

' 8.5 i 
6.6 
N 4.8 



19.9 



I I ~ 

No. of Syllables 

Per 100 Words 

* • 188 
155 
149 

492 



The next step ^\o compute the average ^ for each columns 



^ - 6.6 



.492 
3 



164 



-A. 



The l^ast step is to plot these figures!^ oh the gra|>h developed 
by Fry and observe the result (See Fiq'tires 5-8 and 5-9. In this 
case., the result is* 11, meaning that the approximate grade 
level for the three selections analyzed is the eleventh 
grade. This instrument would be suitable for most graduates 
'and leavers of two-year secondary vocational programs 
(assuminq they were reading at grade level). 



Qn«)h for Ettimoting RMtfaUlity 
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01 REct tONS Randomly select 3 one hundred ¥vord pa$8age9 from book or an article Plot average 
numoer of syllables and average numter of sentences per 1 00 words on grapft to deter- 
mine (he grade level of the material Qhoc se mo^ passages per book tf great variability 
1^ observed and coi^iude that the book has uneven readability Few books will fall in 
^ gray area but when do grade level scores are invalid 

« Count pr(^r n9uns numerals and initialisations as words Count a syllable for each 
syn>tx>i For exarripie 1 94t i$ 1 word and 4 syllables and IRA is 1 wordand 3 syllables 



EXAMPLE 



SYLLABLES SENTENCES 



IV Hundred Words 
2nc3 Hundred Words 
3fid Hundred Words 



124 
141 
158 



66 
58 
6 8- 



AVERAGE 141 



63 



READABILITY ?th GRADE isee dot p:otted on qraphi * 



* t" ' t I' • ir • .ti. ■ 



Source; Edward Fry, "Sutgers University Reading Center, New 
Brunswick, New Cfersey 08904 



ExiMRdad DIreetloiit for Working Readability Graph* 

» • ■ ' » • 

1 . Randomly select three sam^i^ pasnges and count out exactly 100 words beginning with 
the first word of a sentence. Oo count proper nounsr Initiilizations, and numerals. 

2. Count the numtwr of sentences in the words, estimating length of the fraction of 
, the last sentence to the neerest 1/10thv 

3. Count the total number ol syjiables in the 100-word passage. If you don't have e hand 
counter available, simply put a mark above every sylleble over one in each word. When ' 
you get to the end of the pessage, count the number of marks and add 100. Small 

. calculators can also be used as counters by pushing numeral "1 /' then push the "->-" sign* 
^ each word or syllable you c^nt. 



4. Graph avBrago sentence length and average number of syllables; plot dot where the two \ 
lines intersect. Area where dot is plotted will give you ti.e approximate grade level. 

.• ■ ' 

5. If a great deal of variability , is found in sy ll^le or sentence count, put more .samples , 
into the average. ' , .v 




6. A word is defined as a group of symboMl^ a space on either side; thu8/"Joe/' "IRA/ 
"1945/' and are eacH^one word: ' 

• • • . , 

7. A Syllable is defined as a phonetic unit. .Generally, there are as many syllables as vowel 
sounds. For example, "stopped" is one syllable and "wanted" is two syllables. When 
counting syllebles for numerelk end Initializations, count one syllable for each symbol. 
For example, "1945" is four syllables ^nd "IRA" is three sylfables, an^ is one 
syllable. . , ' ^> 

0^ ■ • . 



J • ■ V • 

This "extended graph" does not outrode or re.nd^r the '^arlier 
(1968) version inoperative or inaccurate; ift is an extertsion. 



♦Rutgers, The State University of , New Jerse^r, Reading Center, 
Graduate School of Education, 'N^w Brunswick^ New Jersey. 
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In summary, the readability of the follow-^p instrument 
should be considered in writing the dr^ft, not when the draft 
version is completed. A^IL follow-up instruments* should be 
pilot tested, by a group of present or former Vocational stu- 
dents representative of the instrument's target audi. ace. 
Three^alternAtive approaches to conducting the pilot test 
include: (1) give instructions, distribute, dnd collect in-' 
strument; *(2) conduct interviews after insttument has been 
completed; or (3) distribute instrument wi^ instructions, 
then .donduct telephone interviews, ^ * * ' 

The instrument designer should then apply a readability 
formula to the draft instrument in order to obtain its 
approximate grade level score. Based on data collected 
in the pilot test and the readability formula stages, 
any required modif icatitms or improvements should be made% 
The revised follow-up instrument is now ready to be used 
in the data .collection process. 



Instrument Reliability and Validity . • " * 

When, conduct iiig^ a follow-up study, you must be concerned 
with the' quality of data.' And it is through using certain 
procedures in sampling « 'd.ata collection, and euialysis that 
you cart increase the probability of obtaining reliable and' 
valid data. ... 

t • 

. First, what do reliability ^d validity actually mean? 
Oppenheim relates reliability to consistency, to obtaining 
the same results again. 6^ Validity tells us whether the' 
question or item really measures what it is supposed to 
measure. 66 . . * 

Measurement problems . Aqcording to Phillips, the major 
problem in evaluating the results of any measurement procedure 
is determining what. shall be 'considered as true differences' 
in whatever it is the individual is attempting to .measure 
and what shall be considef^ed 'as variation due to errors ii^ 
measurement. 67 Further, k list of seyeral possible sources , 
of differences among individuals on various measures can 
includes 

o True differences. in the characteristics which one 
is attempting to mfeasure • if 

o True differences in other relatively stable 
characteristics of the individual which affect 
. her/his score . ' 

*» ♦ 

y 
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"o Differences due to tr'ansient. per4oi\al factors 

^' . . • > ■■ ■ ■ / 

o Differences arising from situational' factors i 

. > '. . • • • 

9 Differences because of variations ii\ administration 

• " « * • * • ' 

o Differences due to sampling of items • , " . 

o Differences resulting from an instrument ''p l^ck 
of clarity »' . 

^ " ,• • ■ .V; 

* . «». ' 

o Differences due to mechanical factors 

o Differences arising from factors .in the analysis 
of the data68 ., ^ ^ . . 

> ♦* ••. * ' 

• Although no measurement -is entirely free of error, ' 
minimizing errfirs* should be the'gbal of those responsible 
for c6nducting« the' follow-up study. Errors can be clas- 
sified as "constant" or "random": ■ \ ' ' 

* , f ; ■ 

o ' Constant (or biasing) errors, are introduced 
* " into the measurement by some factor that 
" , systematically (in one direction pr aridther) 
affects either that which is being m^asvired 
or the process of measurement. * 

o Random errors, on the other hand, arise from those 
transient aspects of the individual,. the mensurement 
procedure, the situation of measurement, etc., 
tnat are apt to vary from on^ Measurement to. t}^e 
next, even though that Which Is ^eing measured has 
not changed. 69 * < • 

Phillips also finds that both random anS constant errors 
affect estimates- of "validity," while reli,ability is usually 
affected only by random errors. 70 ♦ . 

To determine reliability and validity of questions on the 
follow-up form, one should look primiirily at the possibility 
of bias due to wording of guestibns, and at problems raised 
by the follow-up questionnaire procedures. 

Techniques for determining the reliability an d 
yalidity of factual questions . A fundamental rule to help 
in establishing reliability and validity is to define a 
criterion — an independent meapure of some variable — to 
which the results* of the questionnaire' ce^n be compared. 
But often, particularly in using foll6^-]|ilp questionnaires, 
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the criteria' are in many instancies difficult to defitie 
• objectively.. However, this shquld not preclude one from 
making the effort to locate suitable criteria. ' 

To estatjrlish a reliability faotpr in the case of 
factual questions, one .should pl^ for a number of internal 
checks. One method is'^to ask the same question in more than 
one way. Another fprm of an internal check^a to include 
erroneous items which, if given answers or endorsements, 
would suggest gue.ssing or carelessness on the part of 
the respbndent. 

> • . 

Another check is to re admin istlfer., the questionnaire.' 
But, wheh making .thift check be careful not to allow too 
'much tilne to pass before re administering sxiryey; true - 
changes in status or behavior may occur in the interval 
which would affect the outcome of this cdmparison. 

\ In a reliability study of one follow-up questionnaire, 
th^e analysis was based on the consistency of group responses 
which were categorized •according to their rate of response; 
early-retumera, intermediate-returners, and la^te-retumers.' 
Puce 1 and Luftig concluded that data fathered from the 
student questionnaire »were sufficiently reliable' to be 
used for decision makina72. 



The content validity of the follow-up instruments' 
can be defined as the relevance of the survey items to the 
actual needs pf students and/or ^utcbmes of the^vocational 
pr<^ram. Therefore, content validity might be enhanced 
^ through an interactive item generation and review process 
" that invoives multiple sources/of inforijiation'. For example 
information about needs shoul^^be sought from a variety of 
. ^ . individuals representing vocational education — teachers, 

\ ' directors, guidance counselors, students, emd employers. 

Nunnally cuid Durham list two njajor standards for 

ensuring content validity : (1). a representative collection 

of items, and (2; "sensible" methods of instrument ^ 
construction . 73 

To determine the validity of factual questions, certain 
checks may be made. One i6 to^obtain a second, independent 
source of information. For example, responses on certain 
questions can be cross-checked with a former vocational 
student, teacher, present employer, or 'parent. In de- 
termining the validity of follow-up* responses with regard 
to defining a dfeclared occupational^ title ^ Adams, Morton, 
and Frazier find no siqj^ficaint differences in the way 
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students ancl teachers answer these follow-up questions. • 
Others believe, hqwever, that fpllowup informatlOT ba^ed 
on teachers* knowledge about & student is" less valid -.than / 
ini^orroat ion obtained directly from the student.' ' 

** • ' * • • * 

One other method to approach aralidaticm is to compare \ 
present findings ^with results Of other foliow-uj>, studies. ' 
'If -there are, serious differences; it will be difficult to ^ 
know which set of results is- more valid. 75 Hence, yt^ aan >i 
say that ;:outin^ fact-gathering to determine reliability and 
validity is, not as' free ^rom .problems as may commonly^ * 
thought. ^But^his should n6t preclude one fro^ conducting 
accepted methods for determining reliability and validity. 

• The best way to determine 'if. directions and questions, 
are clearly seated is'to^retsbt the • questionnaire in ordeir 
to see if these elements are understood and- can be .answered. , 
The instrument should' be pretested with current &.ti^d%Qts 
as well as former 'st;ud6nts.- Students fiay be asked. to .. 4 
p£urticipate in the decisions concerning •type of da^a to be - 
collected, -type of questidns' to be. asked, wordilig of the ,^ 
questions, and designing of the. instrument (includ.in^i the 
physical appearance of the survey form) ; . Time given tp 
pretesting *can save hours of labor by significantly improvina 
the 'response rate, reducing missing data, and increasin^^ 
the reliability of the . instrument . ^ Under the pr&iSs ;of "time^^ 
.this* step* is* frequently overlooked ° or given- only minor 
attention. * • ♦ 

In sumpiaxy, the- reliability and validity -^of a folloW*-^ 
up iquestionnaire can best be accomplished^ by submitting * 
it to critical experts who will, attempt to "picl^^be 
questionnaire apart." It should then be submitted to a 
txiial use on a small Miumber of re.ssipndents. Sudi .an " " 
empiri/cal trial will determine ^f-,the. questionnaire, needs . 
improvements, simplifications"; or revB^gions in presentation 
or arrangement; if the jinfetructions 'smd questionjs are clear; 
if each question is so »worded\as to evoke th^ same inter- 
pretation from' all respondents; an^ if the interpjjetation 
is the one needed to-, obtain the information the question- 
naire was des^ned to obtain. * . . 

Fbr further information and detailed* ddscussion . on * * 
reliabiliti??- and validity of questionnaires, you are #■ ' 

encouraged to review: * . \ , ' . 

o . Construction 'of Questionnaires *(.Duckworth, 1973) 

•0 QueTstionn a ire Design and' Attitude Measurement 
^ > (Qppenheim, 1966) '• \ '. T 
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^'o*> Raliability of the, Minnesota VOQationaX Follow^ • 
e . up stuaent Questionnaire (lE^ucel and Wtlp* lS75l 

l^allel Followup (Adams, Morton, an'd Frazier ,! ' 
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Samplingr^onc^ts arid Procedures * «i % 

PtfiXow-up^ studies usually involve gathering information, 
about a group that comprises a .f ihite population. 
For example, in a follbwrup study oh special populations,, 
the designated subrpppulation mi^ht be female/male handi-^ ' . 
capped completers from a'Guidaj^6a of Children progrstei^of 
the ABC Ariea Vopatibnal School firom 197?, to 19^3, The ' • % ' 
optimal n^thod^ for collectinig information on thesS graduated 

■ is questioning every mem^ser of ' tbe population. A more':fe^sible e 

method is to design a saxi^ling' f>lan to gather Information 

from a portion of the '>opul£ition,' and then to use these, results . > 

'to make inferences* about the ^nt ire .population. This V ' ^ ' 
sectiofi will descirilje the putpose.of :sampling',» the' v ; ' 
chafadteristics of ' a gdod .sample, probability and norir. 

f probability sampling, sampling strategies, and^^sample size. 

Purpose of. sampling . Backstrom and Hurih define samplingr'^» 
as the procedure byerwhich we can infer the characteristics' » w 
jof a large bc^d^y of peopj-e (a "popi^latioh) , although *we^ 
'^talk with only*a few persons (a sample) . '6 Thus, in' sampling, 
we "take" any portion pf ^ population or universe sea * 
rei>resentatiye of that population or universe. This defipi^ ' 
tion does not- saj^ that the saOnple ta]^en--or drawn, as 
researchers >say-rifif representative? but rather, it siays, . * 
the porti^ of the population taken i^ considered, to be , 
representative. 7 7 , - , 

Sampling/ is used in follow-up studies-; and Q|bher types 
of ievalua'tiqn ahd r^earch endeavoi;:a for a number of 
reasons. Prlmari'ly, samples are' drawn bec£^lse it ie not 
practical tp evaluate the trainipg and/or posj:^s6hool 
experiences of all former students. Nor is" it practical 
to^question every person "Vho employs a graduiate of a 
braining program". Therefore, by drawing a repreiSentative 
• sample of j^he total population, one can obtain follow-up 
information in a more cost and time efficient manner.- 



/ 
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Chagaeteg jgtics of a^qood sample . - According to Backstrom 
Hursh, a-good sample is based on the theory that its 

/ ■ ■ ^ ' * • 

1. Provides, ways *to determine the number of 

. respondents n'eeded^ . ^ - r ' '/^ ► . 

2. Specifies the chance* (probability) that any 

person will be ihqluded in the sample ^ \ 

3-. Enables^ i§ to estimate how much err(^ results 
from interviewing, a sample of people instead of 
interviewing all of them 

4. Lets us determine the degree of conWdence that 
. can be placed in population estimates iilade from 
the saijfcle 78^ 



However, there are two minimum requirements: (1) , 
the sample must be adequate in size so estimates 'about the ' 
characteristics of the population can be made" with relative 
precision, and (2) the sample must include' people who 
together are representative of the population. 79 

Sampling procedures . Sampling procedures have been 
classified under various categories. We will focus on 
two here: probability and non-probability. 

In probability sampling, members of the population 
are chqken by chance— for example, by flipping coins, 
drawing numbers out of a "hat, or using, a table of random 
numbers. 80 It is based upon the proposition that every • 
member 6f the population has an equal chance of being 
included in the sample and that there is a known probability 
for the selection of each member of the population to par- 
ticipate in the sample. 

Warwick and Lininger define non-probabil'ity sampling ^• 
as any methods in which units are not selected by chance 
procedures or with known probabilities of. selectifin. 
Therefore, every member of the population does note have an 
equal chance of being selected, because the aim is to 
include specific people or groups of people in the 
sample. 81 

Probability sampling . There are several variations 
probability siunpling, but all s-hare a common trait: 
the selection of units (or members) for the sampl? is 
carried out by chance procedures^ and with known probabilities 
of selection. Five variations are presented below: 
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Simplte random sampling exists if a sample is 
selected from a populatidn in which aid possible 
combinations of n units as formed from the 
population of N elementary units have the same 
cjiance of being iaelude*d,82 . in other words, simple 
random sampling is a procedure 'whereby all* members 
of the -sample are chosen in<lividually or directly 
through a random process in which each member of the 

» population has an equal chance .of being selected. 

*Thus# to draw a simple randomejs'am'ple , ^ach member 
of the total population- must be clearly identified. 

^ There are two option^ in regard to simple 
random sampling,- One is sampling with replacement, and 
and the, other, is sampling vithoiit replacement. Sam- 
pling with replacement is accomplished by replacing ' 
the unit in the selection pool each 'time it is' chosen. 
Sampling without replacement means that the re- 
maihing units in the pool have art increasing chance 
of being selected since the absolute siize of the 
pc3ol decreases. ✓ 

» Cluster samplinc? is a procedure whereby the selec- 
tion of sample .mfembers is chosen from the total 
population in' groups or clusters rather than 
individual persons. 83 The clusters selected are 
often natural or administrative groups of the 
population (e.g., intermediate units county schools) 
Warwick and Lininger cite increased convenience 
and reduced costs as advantages^ to cluster Sampling. 
The major (disadvantage to^ cluster sampling is the 
likelihood -of increased s'ampling error; as the size 
of the sample increases, the' size of the standard 
error decreasies . 84 * v 

Systematic selection is a method of se.lectii^g units 
from a list through the applicamon of a selection 
interval, I, so that every Ith unit on the list, 
followinq a random start, is included in the 
sample. 85 por example, if thfere' are 1000 former- 
vocational students classif iechy4s handicapped 
and 100 are to be surveyed, e^efry tftnth student 
from .the list is chosen to comprise the sample. / 
The main advantage of systematic selection is ' 
simplicity and ease of administration. 

Stratified sampling inyolves dividing the population 
into subpopulations or strata and 'then selecting 
a sample Vvvithin each stratum'.^" in general/ stratified 
sampling is composed of th.e following steps: 

% 
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(a) the entire pQpulation ig, (divided into distinct 
subpopulations ; called strata ? (b) within eIcK 
stratum a separate sample is selected from all t|ie • 
sampling units, composing that stratum,** (c) from 
• the sample obtained in ea^ch stratum, , a separate 
stratum mean (or other statistic) ia computed.' 
These stratum means are properly weighted to form 
. a combined estimate for the entire pppulatioiV; ( - 

(d) the variances are also computed separately ^ 
within each stratum and then properly weighted and-_ 
added into a' combined estimate for the population. ' ' 

The '.major advantages of stratif ijed sampfing as 
defined by Parten follow: (1) 'There is certainty 
that all essential groups will be included in the 
sample. This increases the ^representativeness of 
the sample and .Reduces the possibility of ' an iimpor- 
tant variable (age, sex, religion, etc.) beiilg ex- 
' eluded. . (2) It reduces the number of cases required 
to ensure representativeness. (3) It reduces bias 
which arises from self-selection. U) It minimizes 
costs because the sample is generally- more geograph- 
ically concentrat,ed.88 

There are several disadvantages to stratified 
sampling: (1) Stratification requires prior ,know- 
ledge of the control variable. For example, if the 
contirol variable is vocationaL/pjrograms for the dis- 
advantaged, one must know the . Vocational program 
distribution of the population.5^- (2) If disproportion- 
ate stratification is used, the ^^^4 must be weighted. 
In order to satisfy this r€iquii€ment>iinformatron" about 
the relative frequency of e^en stratum within the popu- 
lation must be known. (3) One may find it difficult 
to find elements to fit the strata. (4) Dispropor- 
tionate sampling requires weighting, which increases 
the cost of the data analysis?^. 

Unequal probabilities of selection (UPS) chooses 
sampling units by a prodedure giving some elements 
a higher or lower<^hance of selection 'than others . 
Therefore, the UP ^ sample includes proportionally more 
of the oversampled cases. One reason for adopting UPS 
has to do with stratification. A subgroup of the pop- 
ulation (minority group or a particular vocational pro- 
gram area) may be extremely important in meeting analysis 
objoctivcs and yet Very small relative to the total 
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•population. When using- sampling units--of" widely * 
different sizes, sii'eh as those groups designated- 
as special populations, the l/PS s'Smple is orefGrable. 
Another advantage is that UPS reduces costs, of 
sampling and/or interviewing. * ,r 

Negative factors include the' need to assign 

compensating weights to sample elements, "an^ to 

apply them dyrdng analysis. Used alone, ,a sample 

drdwn according to' UPS procedures would give a • 

picture of the poE^ulation. * The.ov^ersampled strata'. 

or elements would carry more weight thian they 

deserve, while the rest would be underrepresented. ' 

Other problems in using UPS-' i)rodedures irtay arise . from 

the researcher's inexperience in working with weighted 

data or the lack of appropriate data processing 

.equipment . Any tabulation or calculation based on • 

weighted data is more compl^-cated than the saipie 

operation carried out with unweighted data. The 

„ more . intricate .-the analysis," the gi^eater the* » 
complexities. 90 . - > 

M^lti-sta^e sampling is a procedure for selecting 
a sample in two or more successive, contingent 
stages. 91 -The major ^d vantages of multi-stage 
sampling are convenience and economy. S^ple 
preparation costs are gr.eatly reduced by the fact 
that this sampling 'does not require complete lists 
of individual elements in the population. A majpr 
disadvantage is the increased saikpling errdr^ar'ising 
froiQ the ,selection of sample casesrin groups rather 
than .individually. For a more 'detailed description 
of the procedures involved in doing multi-stage « 
sampling see: '^he Sample Surveyt Theory and i 
Practice ; ' "Illustratioft: A Multi-stage Area 
Sample," (Warwick, and Lininger', 1975) . 

Nort-probabiLity sampling procedures . Three variations 
include : '~ 

° Haphazard samp liric^ which involves the selection 

of individuals on a convenience basis — for example, 
students enrolled in a particular class or people' 
f^assino by one stree^^orn^r. 

o Judgment sampling "which involves the selection of 
samples by individuals uiing thfeir own discretion 
about the roprefeentat iveness of individual-, sample 
<?l^ments. 
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o- ^ Quota samplingr whi^ involtres the selection of 
persons ffrom'^predetennined categories to obtafn a 
i ^peci^i^ number of cases in. each category. This . 
. selection' is done by persons responsible for the 
data collection. 92 . • ' 

Sample size . There are no absolute^ standards r^oarding 
the proper size of a sample, -ilables a^ear in the literature 
which can provide "guesstimates" of the appropriate sample 
dire,*. However, there are some helpful hint6 to Hear in , 
mind when detejfmkiing your samifle. size. \^ 

1. The more homogenep^j.^'^'tSfe population, the smaller 
i' the sample can be^(^ince\ everybne is theoretically 

alike. ^ , ' • , 

^^2, The more time , personnel,'' and , money a\>'ai'lable, the 
larger the sample can be. ' i ^ 

-3. The more categories by which the- sample data are 
to be generalized (e.a., age, sex, type of 

f ' vocatiojial^ education program) , the larger the sample 
must be in order "l^o ensure that there are enough 
respondentssjin ea/dh group so that valid infereijces 
V "^®y ^6 |9ade.' ^ . ^ > ^ • 

4. The more certain you want t;p. be that you reach 
the 'right decision based upon the sample informa- 
tion, the larc^r the sample you will need. 93 

Thus) .while samples that are too sma4.1 thrisaten the 
accuracy of the results', tl^ose that are too large waste SL 
resourced. Therefore, it is imperative that the number of • 
respondents chosen (the ssunple size) be 'sufficiently 
representative of the entite population. 

A. systematic sampling procedure was recommended in 
comprohensive study for the' U. ,S. Office' of .r Education 
to identify 'sample designs for the state follow-up of 
former -vocational edjacation students.- The study proposed 
that thf actual sampling be dbne centrally at the state 
level rather than at the individual schools in order to 
^increase the re^^resentativeness of the sample and to 
reducfe costs. The study also recommended a proposed sample 
size- \ox each st ate yd territo^^ , aid sampling rate 

y*See Survey Research , p. 33 (Backs'trom ^nd Hursch, 
196 3) and Guide to Sensible Surveys , p. 67 (Orlich,* 
et al., 19757"; 
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based on the number of dcenpletions reported to the U, S. ' 
Office or Education .for ^Fiscal Year 1S75. Although 'these 
proposed sanq?li|ig ^ates and the sample si'zes prop6&ec^ shouX^d 
not be regarded as absolutes, or adopted ungues tioAingly by 
^y st^te planning an ongoing follow-up survey, they 'shguid 
be se^n' as representing a judgment of what may be. a reason- 
able compromise between -the conflicting . considerations of 
cost and reliability. ^4 . ^ 

Drawing a^ random sample . ■ In order to ^minimize' bias/ V 
a random sampling procedure Should be used to ensure that 
all cases or elements of a population have an equal chance 
of being included in the sample. 

' Two techniques often used to draw a random sample 
include the lottery Method and the table of 'random numbers. 
In both cases the methods for drawing -the sample can be done 
either manually or by computer. Various statistical packages 
provide computer programs which, with minimal input re* ' 
quireirients, will draw a" random sample. ^ 

One should use the lottery method when drawing a small < 
sample. One method requires the placing of numbered 
pieces of- paper or cards in a container. ' Theft one drawst 
^he number of cards or pieces of paper required for 'the 
sample. Variations of this procedure incfucie using a rou- 
lette or bingo wheel or by simply flipping a coin. 

Use a table of random npmbers for drawing la^g^ samples. 
This method minimizes bias more than the previously 
described lottery method. ^5 T ^ 

.^y^^aiDl&a of random numbers can be found in many research 
and statistics text books. The procedure for manuallf" 
drawing a random sample includes the following stages: 

Identify population and appropriate sample 'size. 

Number all cases in the population serially ' 
starting with 00. • 

To determine the- starting point, close your eyes, 
•and place a pointer on 't\e table of random numlSers. 

•ft. ^ . 

Then reading, l^orizontally , vertically, or diagonally, 
read the numbers to be selected until the total 
sample^ is drawn. A 



1. 
2. 



4. 
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. For example, suppose one needed to draw a sample of 
ten Health Assistant curriculum araduates from: a popula- 
tion of 32 fprmer vocatl^pnal edicati-on students classified 
as economically 'disadvantacred. First, number each forlner 
student starting with 00 until all students received ^ 
a numerical assignment. Then identify a pre-established 

s'tafting point by closing ones eyes 
and letting a finger fall' at some 
spot on page of the table of Yandom 
' numbers. Nexjb, read the closest 
two digits above the fingernail. 
Use the first two digits to identify 
the row, the last two to. identify the 
column. Then select ten numbers. 
For example, if the starting point 
was delected in roW 2, column 1 and 
one read the numbers vertically., 
the sample would, consist of .individufils assigiied to the 
following numfcers: 00, 3,1, 30.; 29, 06, 12, 24, 15, 09, 



00 

01 

o 

o 

o 

31 

32 



Pedro Jon^s 
Maria Jones 



Seon Joney 
Anne Jones 



19 



02 

03' 

04 

05 

06 

07 

08 

09 

10 



Oi 02 '03 04 



08 



S3 


14 


91 


41 69; 


11 61 99 ^ 46^ S6 


66 


84 


62 


64 




31 


0^ 




16 


. " " ' 


V'4 


n 


11 


13 




30 


u 


S9 






50 


A1' 








60 


15 








9^ ' 


.,69. 








. i9 


96 








35 


' 19 


• 




0 N 



One would start in\row-2, column,!, select the first 
individual with th^ value 00, then proceed down the 
column . One wpuld continue by going to the next column A 
and so on, using a Vertical reading pattern until the sample 
of ten 4rs chosen from numbers 00 through. 32. 

individuals who have access to comji^ters may find that 
using a computer program to dra.^ a sample is, far easier 
and more time saving. This is ^rue if large samples are 
needed. ) 



•In summary, while catefi^il sampling is extremely important 
in survey research , ' it is Ibut one part of an integral 
process. Sampling is only\one of several sources of error. 
The quality of the questidnhaire , the overall response rate 
in ^intervievinq, and the ^terviewing and reliability of 
the cod ina aire other factors which 5>influeace the 



V 



accuracy 



^ ^ ■ . \ 

of the data, •Hius, in pl^anning a follpw-up survey, one 
should aim for" ah adequate -balance of precision and quality 
at. all stages. There is little to be gained from a very 
precise sample which is undercut by a low response rate, 
poor data collection procedures , . and reporting errors. 



The followingvchecklist presents five important factors 
to consider ip developing the sampling plan. Figure 5-10 
provides a nummary of sampling procedures, arid Figure 5-11 
defines' the varioils d^cis i on -malld,nV steps involved 'in the 
development of the appropriate sampling procedure. 



Checklist for Sampiiog Procodurei 



Yi8 • No 



Does your follow-up system's sample provide the following^: 



1 . The desired information, Accurately, at the desired price? 

2. Random sample selection by: 

a) simple random sampling? 

b) stratif fed sampling? 

c) cluster sampling? 

d) systematic selection? 

' e) unequal probabilities of selection? 
f) multistage sampling? 

• ♦ 

3. Non-random sample selection by: 

a) haphazard collection? 

b) judgment sampling? 

c) quota Sampling? 



4, 
5. 



An appropriate sample size statistically defined? 
Response rate statlsticaHy* identified? 
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Figura 6-10 > 
Sampling Chart 




r<aiulam 



BriVf DoBcriptlon 



Assiqn to ehch population 
fn<2fflber.a unuKue miobori solcct 
e<!a)plb„it€ma \y udo of random 
nuatore » 



Advantages 



l» Requires, minimum knonirlodqo 
of populatlo|t In advance* 

3* Froo of possible classlflca- 
t ion errors. • 

3. Easy to analyae data aM 
ccppute orroro* 



Oisadvantaqos 



1. 



2. 



poes not make use of knowledqe 
of poimlatlon which rosearchor 
^may have. * 
Larger errors for same sample 
9i80 than in stratified 
sampling* 



Use natural ordorVm.or 
order population} \oloct 
Random starting poll 
between 1 and the neWest 
tntoqor to the samplibq ratio 
(N/n) } select times a^ interval 
of nearest integer to 
sacplli^ ratio. 



If population Is ordered 
with respect to pertinent 
property^ qivee stratifica^ 
tion effects ami hence 
reduces variability 
compared to A. 



4 a. Slmplicity df drawl 



sapple» easy to chocl<» 



If sampling interval is 
related to periodic ordering 
of the population^ Increased 
variability nay be introduced. 
Estimates of error likely to 
bo high where there is 
stratification effect. 



M.Utl stage 
rtndcm 



With 

probability 
propertxonato 
to their 
slae. 



Use a focn of random sampling 
m each of the sampling^ 
stages where there are at 
least two stages. 



Select sampling units with 
probability proportionate 
to their 8iso» 



8{ffiipllng llsts^ identif ication* 
andiftumbering required only for 
members of sampling units 
selected In Sample. 
If sampling units arc 
jGfeoqraphically defined » 
cuts down field costs 
(I.e.* travel) . 
t^educes variability. 



1. 



errors likely to be larger 
than in A or B for same 
eamislo slaO. 

errois increase as numbei^of 
oamplinq units selected 
decreases . 



Lack of knowledge of sUe of 
each sampling unit before 
selecting Increases variability. 



Stratified 
Propor** 

t ionate 



Select from every sampling ' 
unit ex other than last stage 
a random* sample proportionate 
to fiite of sampling unit.. 



1^. Optimufit 
allocatvon 



3. Oispropfer- 
t lonate 



Same as 1 except sample la 
proportionate to variability 
within strata as trell as 
their sise. ^ 
same^as 1 except that slse of 
sample is not proportionate 
to site of sampling unit but. is 
dictated by analytical con* 
slderatiofts or convenience. 



Assures representativeness 
with respect to property 
which fona^ basis 6f 
classifying units; therefore 
yields loss variability 
than A or C. % 
Decreased chance of failiri^ 
to include mcnber^ of popula* 
tion because of .classification 
process. • , . 

Characteristics of oach^strattfa 
can be estimated and hence 
comparisons can be made, 
tpos variability for same 
samp(e slse thaml. ^ « 
i 



More efficient than 1 for 
comparison of strata or where 
different errors are optlmton 
for different Vitrata. 



iiqquires accurate information 
on proportion of population 
^n each stratum « otherwise 
Increases error. * 
If stratified' lists ar<> not 
available* may be costly to 
prepare them? possibility of 
faulty classification and 
hence increase in variability* 



Requires knowledge of ^ 
variability of pertinent 
characteristic within state. 

Less efficient than i for 
determining population 
charactvi'i'ctics; i.e.*wcrp* 
variability for same sample sl£f». 



Reprinted from Rassell L. Ackoff , p The .Design of Social Re- 
search. (Chicago: University, of Chicago, 155-3), p: 124. By 
permission from The University, of Chicago Press. Copyright 
1953 by The University of Chicago. 



F^me*10 -Comitiued 



typtt of « 




Advantages 


MseAmtages 


> 


deleot Mo^Ung \mit6 ^ acne 
e^ni of Ma^Unsi 
ttltitf^te units m dm^t 
8«ieet tiM'e at rondo» and tako 
« cmpie^e count of 8«oh» 


' I, If clusters ace geograi^cally 
defined* yields lowest field . 

09St&» M 

a» Inquires listing only in- o 
dividudls in seleeted o lusters. 

3. Charaeteristics of elustero as 
itell of those pi pe^Ution 
can be sstiasted* > 

4* can be used for subsequent 
aaoplesf sinee clusters^ ^t ^ 
indivi^ls, ere seldcted, and 
substitution of individuaia 
, mey be perttissible> * 


':—4 • u ■ 

I'. Urger ercoTft^ for ecttpajoible* 
Anise than ether probability 
; samples* 

a« naquires ability to assigfh 
' taoh mosber ef pdpyUtien 
wi4quo4y w e eiustwi »n« ^ 
«Mlity to do so may result 

; in ^plication or aaission 
of indivi^isls*^. ; 
• 


suat i fled 
clitgter 


Select clusters at random 
from every aaBH^ling unit, 

• 


I* Reduces variability of 'plain 
cluster sampling*. 

•» 

» / 

/ 

* 


• A 

l« DisadS^tages of stratified 
saoipling>|ided to those of 
cluster pn^p^rti«i» 
3« Since cluster prmrties * 
ciwi^o^ aavantege or stratHioa* 
tien may be reduced and mtd^ 
MBple umisebU for later 
»eoearch« 


Q. Repetitive t 
rultipio or 

• 


1V0 or more samnlea of any of the 
aijova typsa ar« Uksn* using ra- 
tulta frcn earlier saDplea to 
design later onea, or datsimine 
if they, are necessary. 

/ 


I. Provides ABtl^es of populta- 
tlon oharftteristies irtiichT 
faeilitate efficient plannilb of 
succeeding sample, therefbrJ re* 
duces error of final eatimatfe* 

a. In fhB long sun reduces ntsBber 
of mervatiofs required^ ' , 

\ ''4 


I* Ccnplicat^ steiaiatration of. 

f iou eoriu 
3« More coBptttation and anaXysia re- 

saspling* ^ 
l» Sequential senpliog can only be 
used latere a sasll sople 
can approsiffiase' nqNKmntetive* 
nes^ and itteore the mater of 
observations ean be inereaoed 
eof^nientiy at say stage of 


H. Ju4i|Dont 


Select a aubgroup of the 
population which, on the baoia 
ot available inforoation, can 
bQ ludgod to he reproaentativo 
of the total population) toko* a ^ 
complete count or sub-^sample 
of this group. 


I. Reduces cost of preparing 

sample and»fioU work* since . 
ultimate units can bo selcKrted 
so that thoy are close 
tori St her. 


the research. 

I. Variab^ity and bias of 

estimates cannot be meaaurd 
or controlled* 

• « 

/ # . 
1 


, 


Classify population by ijertinent 
•properties 1 doteroind desired 
proportion of eaopXo from each 
cIa8S{ fix quotas for oach 
obop rvpr . 


1 . Same as above . 

a. Introduces scoe stratiflca-* 

ticn effect. « 


; — ' k- 

I* tntrodttcos bias of observers* 
clad8ifTCation*of subjects and 
non«*random selection within 
classes* c 
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FollowTUP studies an d National Information and Data Svatema ' 

* ^ ^^^^ the passage of the Education Amendinents of 1976, three 
federally initiated data and information 'efforts were started. 
These included t (1) The National denter for Educational • 
statistics' Vocational- Educiktion t)ata System (VEDS) , (2) the * 
Departments' of Labor ^d Health, Education and Welfare National 
Occupational Information Coordinating Cqnmittee (NOICC)-, 
(3) and the NOTCC counterpart in each state, the State Oc- 
cupational Information Coordinating Committee (SOICC) . 

.Procedures developed for conducting fdllpw-up studies of 
th^^special populations should reflect the xequirements of 
theS^*t>ational information and data systems. The following 
n;arrative outlines tenative requirements of three informa- • 
tion systems. These systems are In an evolving stage of 
'development, however, the propos.ed ideas should be considered 
in designing follow-up studies for the special populations. 

. ^ The Voclt i'on'al Education Data. System .* Thfe following 
infoCTiation was obtained from t^e Veds feasibility studies. 
The VEDS system proposes to requl'fe states to collect, follow- 
up data from former vocational education students and their 
employers. These include the Cojnp^leter- Leaver Pollow-up " ' 
Form** and the Employer Pollaw-up Report. The proposed former 
student follow-up. forms would require the followfng "data 
and information: * • , " . •/ 

. » .• 

o Education status 
o Employment status 

a Emplbyer, supervisor, job title, and job' duties 
o .Job relatedness td training 
o • Current salary 
o Hours employed per week 



♦Source: The information for this subsection was oTstain^d 
from the following: (1) Draft forms for release at tt\e . 
Annual Meeting of the American Vocational, information • 
Association (AVIA) , Oklahoma City, Oklahoma., May 22r24', 1978; , 
(2) Wolfsburg, "VEDS Feasibility Study," presented at' EPDA 
Inservice Workshop for State Plannera/Evaluators . Oklahoma^' . 
City, Oklahoma, Match 28-30, 197^.; and (j) National Vocation- 
al Education Data System Workshop (material prepared by the 
RMC Research Corporation) November 13-1-7, 1978, Chicago, ' 
Illinois. 



**S8e Appendix A, pp. 240-2 41, for copies of proposed VEDS 
Pollow-up Forms, 

-lis- ' ■ . ' 



The completer- leaver (high schobi, postsecondarv. adult) 
. Follow-up'Reportf will be divided inti. lour wrtf f ^Pa?t A 
presents infon^ation on the employment stratus of the 
follow-up sample- for each instl'uctional program. Pari B 
describes , the employment status b£ the f oljow-up ' samp^ toy 
racial/ethnic designation and sex. Part C describes the 
gmpioyln^nt* status of those individuals^ iti the follow-up* 
sample who are handicapped. Finally , -Part «0 presents ; fdr 
each prograin;^the field of employment and average hourly • 

!f if ^ i ^^2^® individuals, in the follow-up sample who 
were employed. , . 

The Employed Follow-up Report Vill be" divided into ^ 

?n«?^,^5!: ^ summarizes the ipean employer -ratinab 

by instructional program of the former student. Part b' 
*in5 the average ratings by racial/ethnic designation 

and sex of the former: student.. Ps^rt C presents- averace 
employer ratings by the level of- t^e. prbgram and the ' 
completion status of the former students. 

. The VEDS data ree[uirements for the follow-up of " 
employers would Include information obtained from the 

^supervisor for the most current employment cited by each. 

. completer ^d leaver in the student sample. The specific 
data elements include: fc^^j-x*. 

o Evaluation of te,chnical skills (compared to others 
m the 'same work gsQup) * * 

♦ ' « » • 

Job knowledge: technical information possessed 

- Readiness to.- learn new techniques ori the job 

- Productivity, ability to meet quantity demands 
Accuracy of work , quality and tl^r|3ughness 

' - Did student require any- on-ther job draining? * 



*The ernployers would be asked to rate the individual on 
those data elements according to the followi-ng criteria:- 

A V Did not meet requirements 

B - Usually met but rarely exceeded minimum requirements 

- Met and sometimes exceeded requirements 
D - Exceeded requirements to an exceptional degree 
E - Irrelevant or no opportunity to observe employee's 
performance" . • . 
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o Evaluation of job readiness (compared to others 
in'tK© a&m work group) ; \ 

. V> Positive attlt^iid^^ toward* worlc . 

Realis^iq concept' of what job involves 
Dep@ndabili.ty, attendan6e, and pui(^ctuali^ty 
-r' Initiative, to perfoarm job tasko 
- - Ability' to get alon^ with others 

Judgntentf ability «^o' make' decisions, planV^ 
y ^ organize * ♦ . 



'pThe propbsed /bllow°up activities *would be conducted 
in February of the expropriate fiscal year. Those former 
vocational: students' to i>e fplloVed-up includis completer's 
and leaver? of ttiose prbgramS of . Part A of t^e program 
-enrollment and. temtination report (enrollment will be- 
. counted upon official entrance^ into a vocationa;! educ&^ion 
p;rogram at the level at which a' vocational objective - can be 
stated or implied).. Only persons enro]»led %i a course a 
.service, or activity. unique fy and 9Pecif iially ^associated . 
.with ^six-digit program code will be reported here. No\ 
enrollment, below, the ninth '..grade* will be reported* Also^^ 
the reporting is limited to those programs covered by th^ State 
Plan. Furthermore, the universe is restricted to high school 
'stu^entf'., postsecondary students, and adult students, .' " 
enrolled in long-term programs (at least 500 contact ° .. 
hours in length) .. . . ^ ^ . ., ' ' ^ > '■ 

•Employer follow-up forms 'would be sent only to the* 
employers of those students who 'indicated that they were • 
employed (either civilian or military) in the student 
follow-up- f6rm (NCES 2404-5) . Two. forms of sampling are 
proposed in the VEDS follbw-up component. 

' . ♦ ■ 

In the first sampling, option , a state may elect to 
partition ' its school districts and postsecondary institu- 
tions (LEA/PSIs)" into a maximum of five groups of LEA/PSls. 
The state may then restrict its follow-up activities to 
one group of LEA/PSIs per year, rotating to ^ the next group 
in the next year so that in, at most,' a five-year cycle 
each LEA/PS I will have beei> .included in the follow-up 
activities. 

The adoption of this strategy is subject to the. 
following restrictions: • ^ 

1. Each group of local education agencies and post- 
seCBQndary institutions (LEA/PS.Is) must have ap- 
proximately the " same total numbfer of /'Part A 

•enrollments." That isv uf the state elects to 

J * • 

' \ -12t)- ■ 

r ♦ 



partition its LEA/PSIs into five groups , Wh©n each 
group shall account for approximately percent 
of the total "P^t A enrollments." 

* 

2. * Insofai? as possible under the constraint above, 
each group shall have approximately the same 
e;irollments in each Part A program. 

3. Before any state could adopt this strategj^ 
(which allows for ihe follow-up of le^s than 
the total follow-up of universe in each yeai;) 
t^at state must ^su^j^t a technical 'sampling plan 

' to NCES and recetVC^approvat in writing f rom NCES 
for that plan. The. sampling, plan must coi^tain ' 
the following: -'' ! 

a. A list of the LEA/PSIs ih each group 

b. The total enrollment of each "Part A" pr-6gram 
for each group for the most recent ye^irs 

c. v A determination of which group (s) is doing to 
be followed up in which year(s') ! 

d. A rationale for how the groups were deitermined . 

e. A discussion of the degree to which each group 
is tepresentative of the state ^ 

4. The intent in permitting this extensive use of 
sampling is to reduce the cost an^ effort required 
to conduct the followTiip activities. The trade- 

. off that NCES expects is that 'those states adopting 
a plan which includes less than the total universe 
each year will devote- extra attention 'to obtaining 
quality data with acceptably high- response rates. 

The second form of sampling occurs with' respect to • 
those leavers who completed at most half (50 percent) of 
the program. Specifically, within the group of LEA/PSIs 
whicl ,s to be followed up in the current y<ear, the fol- 
lowinc completers and leavers must be followed lip: 

1. All completers ' , ■ 

2 . All leavers who completed more thfan 50 percent 
bf the program 

3. Ten percent of the leavers who completed at most 
. 50 percent of the program 
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National and jfltat©; Occupational Information Coordi na- 
tion committees . H witn the eatabilgkntftnf ,r»# 
occupational InfdVitmtion Coordinating Committee (NOICC) ^ 
and its counterpart, the State Qtecupational Information^ 
Coordinating Committee (SOICC) , Congress intended to ■ 
legislate a more integrated education and training system 
in the United States. Through the passage of the Edvication 
Amendments df 1976 , .Section 161(b), attention was drawn T 
to the need to deal with data and information systems foxi 
and among education and training prpgrams. NOICC s 
•charter > concisely stated. Is to: 

• "^^ ' ■ ■ 

1. Improve communication and coordination 



2'. Develop(<..-and implement an 'occupaj^ional information 
system ♦ . ^ * • 

With improved communication, it is anticipated that 
education and training pl^nners^ operators, and administra- 
tors will better understand thedmmportance ofv occupational 
data and information, the value -^Jf stich information, and. 
how information can be most effectively used'. 

The NOICC/SOICC network can become an effective tool in 
improving communication and coordination.^ The "bottom line" 
jneasures must be in terms of the impact on program structures. 
The NOICC/SOICC network will work toward eliminating duplica- 
N^^^ survey activities in labor markets or other subsiate 
■^eas, and assist in increasing the number of completers (of 
Education and 'training programs) who find jobs /in the local 
markets. By accomplishing those objectives, the network believes 
that they will have begun to achieve the congressional intent.. 

The second mandate is the development and implementa- 
tion of an occupational information syst^em. . This system 
must qb beyond the supply/demand .information stage apd ' 
• incorporate data on wages and salaries, information on 
training opportunities, information on career ladders, and 
ihe myriad of other' data and information needed by various 
users. As stated earlier, here is where the follow-up 
system or study, specifically interfaces with NOICC and 
SOICC; it car) provide for many of those data elements 
or in validating certain data. 



♦Source: Davis A. Porter, "NOICC/SOICC 6oals and . 
Obit^ctives" (A presentation delivei^^ at the State Occupa- 
tional Orientation Session, WasJ)ington, D. C. , 1977). 




The position and/or function of SOICCs is still to 
'be determined in many states; however, some of the technical 
areas that are and will be of concern to SOICCs include: 
.program planning! feurriculum design, data collection 
(including both Administrative data systems and general 
purpose systems)/, program implementation, program evalua- 
tion, and follgw-up. * 

» 

In summary, the VEDS proposes a follow-up component which 
defines a minimum data base for state efforts in conducting 
follow-up. The NOICC and SOICC focus on occupational infor- 
mation for planning and programming which data from follow-up 
studies can be integrally^* related. Specifically, the iden- 
tification of completers, jobs obtained, wages, and salary 
are types of elements that can be used to help build a NOICC 
and SOICC data base. .The personnel at both the SEA and LEA 
level must be acquainted with the purposes and operation of 
the National Information and Data Systems.- As these systems 
are further developed and become fully operational the indi- 
viduals responsible for conducting follow-up studies at the 
state and local levels should establish cooperative working 
relationships with those mitional systems. ' - 
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> , SECTION 6 



USING FOLLOW-UP DATA AND STUDIES 

In section,!^ the rationale for evaluation^ and follow- 
up. studies o| special populations Was discussed. Although 
it is not necessary to reiterate the rationale here, the 
reader should, bear in mind that follow-up studies are a type 
of suinjnative evaluation activity. The information greaned 
from the follow-up studies should aid in decision making if 
»the data are analyzed properly and reported effectively. 

Proper data -fi^nalysis and effective report preparation 
are signif i<Mint detefrminates in the use of follow-up data 
and information. One example of^ an effective reporting of 
a follow-up study of high school dropouts is found in Appen- 
. dix^ G. This brochufe deceived the 1977 award from the 
American Educatdonal, Research Association, Division H, 
Evaluation as the "Best Evaluation Report Brochure." 

# 

The readet ii encouraged to review section 5, "Data 
Analysis and Reporting Pro&edbres, ^ in Evaluation Handbook ; 
Guidelines jnd Practices for Fo llow-up, Studies ji,^iume Ofte . 
^u-ideiines for interpreting <|^ta and the organizaton and • 
formating of follow-up reports are 'highlighted. 

The results^ of a folldw-up study can be used for a 
variety of pur^>osea. Within the educational agency, the 
.report can provide a base for making decisions, regarding such 
areas as programs, services, and equipment for special popu- 
lations. For those not directly connected with the educational 
agency, the follow-up resists can best serve as an- account of 
the school's sucqess in preparing students for work. Because 
the audiences for- the follow-up study differ and because 
follow-up information is used in different ways, 'reports 
presenting follow-up dat^ should be tailored to specific needs 
of the intended audience. Basic factors to be considered in 
the use and applicability of any follow-up data are found in 
Figure 6-1. 

Follow-up stijdies are primarily status reports. Their 
use isVbased on two assumptions: (1) that the 'status of a 
group of former vocational students in the future will be 
similar to that of a previous group unless changes are made 
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Conifaltratloni ii^ Un and AppilMbiiity of Pol 

1. Change usually takes place on the school and classroom levels. All pe^nnel who might 
be affected by anticipated changes should be involved in the design of follow-bp studies. 

2. Follow-up information can be used to substantiate qualityVograms and positive situ- 
ations. It should not be viewed soiejy as a program designed to reveal weaknesses. 

3. Follow-up information tends to reveal whiit kind of courses and programs students should 
not be trained In. It cannot always reveal what alternative courses should be offered. 




^ta from the fbllow-up process can be used to assess teacher effectiveness, it must 
be remembered that students often tend to rate courses according to. their feelings about 
the teachers. Teachers rated low may be excellent teachers. 

6. Follow-up data maiy times provide the impetus fer change but should rarely be the sole 
cause of or basis for change. Information must be gathered from as mbny sources as 
possible before action is taken. 

6. Studies ms^ indicate certain areas of concern, but many times there is no fotlow^through 
on them, nt Isihe job of the appropriate Miministrator to use the Information to make 
needed chaoges. • v 

7. Some administrators and teachers are not convinced of the benefits of using follow-up ' 
data. These benefits must be revealed if the infbmiation Is to be used effectively. 

8. Some administrators and teachers feel threatened by the revealing look at the conditions 
in their institutions provided by follow-up studies. This threat must be minimized to 

' ensure the best use of the datai 

9. Follow-up is a slow process: it may take several yeare for significant trends in follow-up 
data to abpear. If a significant trend or point In the data appears to emerge, it should be 
checked against information from as many sources as possible. 
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and, (2) that the conclusiona and reeommendatio^is included 
in a report of follow-up data^ vaiuaj&le in guiding 
decisions about changes to make to improve the status of ^ 
future groups.^ . ' , 

5° ^^f^^®? step, thol^e persons , directly connected with 
relate'^to: a jency should determine if the recommendations 

ly Policy (4.g. , program focus ir\ regard to students 
and cojnmunity/labor market) 

2. Staf^ (e.g., inservice training on new instructional 
materials) •<> 

\. 

3. Services (e.g., student selection of programs) . 

4. Programs (e.g., modif icati^ons that reflect new 
skill requirements) ' 

* • ' ■ 

5. Equipment (e.g., purchase of adaptive devices to 
aid the handicapped in performing the skills 
required in industry) ^ 

Kf°^*S^ changes, which can havc^ far-teaching consequences, 
2 I^'^? only by top-level administrators in conjunction 

K Decisions do npt af fbct policy or 

th9 budget should involve those directly influenced by the 
consequences df the decision, if a suggested change is 
related tcp curriculum content, for example, then only the 
iS^^i • r"®""? committee (s), in st rue tor (s), and curriculum 
coordinator shopld decide on tlfe change. 

-The follow-up report can also influence the deci^ons of 
those not directly connected with the educational agency. 
But persons or groups ouiside the educational agency can only 
suggest that certain decisions be made and have little or no 
authority to implement change. Perhaps the greatest impact • 
a follow-up study has on persons outside the educational 
agency is on attitude? the public's attitude is directly 
related ^to how well they think the school/college prepares 
students. Certainly, one of . the most significant uses that • 
the public can make of follow-up is to help determine the 
K"*:i^^u° school's programs. And this. determination can 

be the basis for decisions to provide— op not to provide— 
financial support for an educational program and/or agency. 

Follow-up and th e Management Information System (MIS ) 

Two of the process objectives of a vocational education 
management information system include collecting data.^nd 
developing a comprehensive da^ta file. A critical component of 
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such a file is follow*up data on former vocational students. 
This data can be analyzed to support the decision making 
process. The extent to which a management information system 
supports the decision making process is'^the key to that system 
effectiveness. * ^ . 

One advantage of a MIS is the level of ' detailed|^inforina-> 
tion it makes available regarding individual students and/or 
programs. Combining the |.nformation. collected by a fdllow-up 
'study with other evaluation data provides a basis for a 
, detailed analysis to identify problem areas- and probable 
causes. For eximple, a dat^ analysis might reveal the follow- 
ing information about a student: ^ 

1 . A low grade point .average 

2. An excessive number of absences during each of the 
previous two years 

3. Social problems while in school and/or on the job 

4. Dissatisfaction with school programs and/or with 

^ the present job ' . • 

Since all sections of the MIS can be made to interact, 
the system offers many advantages-. For example, the* MIS per- 
mits a decision maker to ask questions on the probable effects 
that a decision or a series of decisions rerated to one sub- 
system can Have on the o'-.her subsystems. Thus, if it is 
tentatively decided that a number of different students with 
certain characteristics are to receive individualized train- 
ing and group counseling on occupational mobility, then the 
MIS could be used to determine the possible implications of 
this decision in terms of facilities, s^ace, extra cost, and ' 
added personnel as well. , . 

When viewed from this perspective, follow-up information 
can be seen as a feedback component of the MIS. This compo- 
nent can be the basis for isolating possible causes of 
undesirable effects on students and for analyzing proposed 
changes in instruction, services, etc.', to determine the . 
potential effects. In other words, the MIS can be a dynamic 
management tool for analyzing needs, in forming decisions > 
and considering the probable effects of those decisions on 
the local educational agency. 

# 

Using Follow-up Information for Policy Planning 

Extensive planning and informed decision making are 
critical to the success of vocational education. A complex 
array of variables must be (considered when designing programs 
for a comprehensive vocational education delivery system. 
Comprehensive planning requires decisions based on data tol- i 
lected from several agencies, including vital information- 
collected through follow-up programs. 
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Determining educational policy decisionp .is a formidT 
able task. °lt is evident that issues ^. however 'they are 
defined, are complicated and>ii|iportant. A cursory examina- 
tion of ^almost arty educational decisicm reve'als a mi'n-d- 
boggling^ complex of inter-re lationeihips and variables. 
Everything, it sometimes seems, is reiated to everything 
else. ' • • . . . 

Edijcati*onal planning^ and decision making ar6 extremely , 
cortplex *on any level. dne''must attempt to obtaift 'as much' 
pertinent information as possible while, at the same time, ^ 
*exclu4ing irrelevant d^ta, suppressing unprofitable inter- 
action, and ignoring extraneous variables. .One must' focus 
attention on the exact problem while simultaneously eonsid- 
eriivg the outcomes, of all possible decisions. ' . ' * 

* Decisions regard^ing. alternative approaches , positions', 
or procedures. Should all be based on objective information. 
The decision to maintain ^ expand, reduce, or eliminate^ a' 
program, fpr example, can be- reached, rea^onabl^ only wlien * 
d^ata are present for comparisonr and. anal^is. Acco«dingly, 
data utilization of this nature not only aids those makincr 
decisions but ^Iso justi'fies the decisions to other individuals. 

' - - • ' . ^ ' \ ' . 

Foll'ow-up data are essential to the establishment ^nd 
assessiQent of goals and objectives, which "^e logical 
concomitants to effective planning and decision making. 
Administrators cannot develop and institute such items as 
comprehensive plans, capital outlay budgets, federal 'funding 
guide requests, school plant needs assessments, and cuarricu- 
lum guides without an extensive -data base ^generated in part 
by a vigorous follow-up program. Similarly, the judicioui ' 
planniVig of program or course^ objectives and teaching ' 
strategies can be done most effectively when the individuals 
involved have ctojective follqw-up data at their disposal, 
f 

Innumerable variables are 'associated with educational 
change. The complexities that must be considered by educa- 
tional planners offey evidence that as much information as 
can be obtained must provide. the basis for educational 
decisions. While follow-up data are merely one segment of 
this total or necessary information, these data should never 
be underestimated as a crucial component fo^r assessing the ^ 
needs and relevance of vocational programs.' 

It appears that no magical formulas or hard and fast 
rules for successful use of follow-up Information currently 
exist. Both those who generate "and those who use follow-up 
data fiind it difficult to translate their successes into 
exact procedures for others to emulate. However, the 



following Insitancea drawn directly' from the field -may be' . 
considered helpful examples of the, use of follow-up data by 
decision makers* . These examples were selected as reeresen-, 
tativ© of th^ ro'any types of change occurring within the\ * ' * 
schools and may -be considered typical. JgWile th^ descriptions 
pertain to programs for special populations or components 
available only in certain institutions or .schodl districts, 
the principles- behind them have Ifroader application. 

• Exang>le 1 . Information from annual employer surveys 
in a ' large school district revealed that employers frequently 
commented that former vocational students lacked essential 
employability skills. A closer look indicated that some , 
students did not know how to f^ll out employment applications, 
-conduct themselves in job interviews' or keep jobs once they 
found them. 

. » * 

The vocational director, other administrators, and 
occupational specialists met and formulated a plan' to prepare 
students for .entering the job market. As a result', several 
large h"igh schools in the djistriat now offer "employability 
skills", as a separate . course cn' the ninth or tenth-tgrade 
level. Furtbermore, every high school, regardless of size, 
offers a unit of employs^biility skills in certain- kcademic 
and "^11 vocational classes. The program has met with favor- . 
able ' comment from both employers and students, and recent 
survey data have teifded to substantiate the conclusion that 
the new efforts have better prepared the district's students 

'for the transitj.on from school to work. ^ 

, . ... 

Example 2 . .Employer surveys conducted by a' small com- 
munity fioilege reyealed that some former business students 
were failing to meet the minimum typing performance standards 
required in certain occupations. The head of the business* 
department checkfed the typing program and noted that testing 
procedures for typing speed and accuracy were not coniistent 
with th'ose used, in business and industry. Because the 
employers* ^required word-per-minute rates were somewhat 
higher than the, schools, some students were failing to meet 
minimum performance standards ciemeuided in certain job situa- 
tions. . ' ' . 

Consultants.. -among 'the business staff aid individuals 
from government , "^"business and industry lead to thi develop- 
ment of guidelines and procedures for teaching and testing the 
typing skills students . would* need on the job. Subsequent 
follow-up surveys have reyealed a sharp drop in comments 
tcom employers about deficient typing skill's among the 
college ' s .former stddents. 
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Example 3 > Enrollments in a machinist program at a 
small vocational school had been steadily declining for' 
three years and ha0 .reached such a low level that the entire 
program was abq^t to be phased qut. While considering the 
fate of the program, the director-. analyzed the follow-up 
information to locate possible trends. Student comments 
revealed that many graduates complained of poor facilities 
and the use of obsolete, run-down" equipment . ^Impl.oyer data 
indicated that most graduates had to bfe extensively retrained, 
apparently 'due to the minimal sicill training within 'the 
program. Additional checks of employment trends and graduate 
placements, however, revealed that a definite need. for • 
machinists existed in* the community. 

Through consultations with other administrators and 
representatives from the state department pf education, a 
decision was reached to attempt to revise and ^update the 
program. A state grant was- obtained ^o aid in the revision 
of qurricular material, and a federal grant was also 
awarded to increase funding for new equipment /and facilities. 
Input from the local vocational advisory committee was 
elicited and utilized during the renovation of the program. . 
The program now places a very high percentage of its graduates 
in jobs for which they are trained, and negative comments 
about the program have markedly .decreased. 



• Using Follow-up .Data for Program Planning and . j 

tmproveit^nt f 

Great care must be taken in planning or improving programs 
on the basis of follow-up inf ormfation . One musit, always 
remember that follow-up informatdon tells only Vhat happened 
and that it is difficult to determine the cause of something, 
if only the effect is known. One must be especially careful, 
for example, of citing faculty course content as the cause 
of students' inability to find related work. Consider the 
following situation. A co^unity' college has a forestry 
technology proararr. However ,. consider this additional data: * 
most states and thie federal government require that applicants 
for jobs in' forestry technology be of a certain age. Many 
of the graduates oi the community college's program are younoer 
than the required acre. Therefore, regardless of the quality 
of the program, the graduates cannot get jobs with the state 
or federal government if 'they do not meet the age requirement. 
Almost none of the graduates of this program cah find related 
work. This piiciht lead one to evaluate the program as beinq 
of low qua 1 i ty . 



One must also remember that the' results of one folloW-ue 
steady may provide insufficient evidence for planning or 
irjproving programs. Even if three or four follow-up studies 
h^ve been conducted, other information may be necessary.' 

Again; consider a relevant example: .Over* a three-^ear " 
period, the proportion of graduates^ of a particular program- 
who found related work has been decreasing*. While the 
follow-up information can suggest some causes of the problem. 
It cannot address such possible reasons ks the > following : 

1. The demand for graduates with the skills provi4ed 
by the program is decreasing, 

2. Other educational agencies are preparing students 
with these skills at an increasing rate and are 
therefore causing an oversupply of job applicants. 

3. the skill requirements for the related occupations " 
are changing and graduates trained according to the 
old ski IF requirements cannot compete for the job 

I openings. 

4. An increase in unemployment is causing a temporary 
decrease in demand. j - 

5. The quality of the progr^ is deteriorating. 

4 

6. A combination of the first five phenomena is ocpurring 

Thus, there are many possible causes, and to blame one is 
to ignore all other possibilities. In the example above, ar^ 
analysis of market conditions., competing educational agencies, 
and skill requirements must be made before a cause can be 
determined, 

F<pllow-up information can be a primary indicator |n 
determining whether program planning, improveme*ht , or Change 
is nec^sary, but it can supply answers only on- what 
happened--"not on why . To determine causal factors, such other 
information as labor market factors, data on competing insti- 
tutions, occupat/ional skill requirements, and program content 



must be examined. 
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Using^Follow~up Information for Improving Services 

Former vocational s^udVnts' responses to questions ^ 
related to services provided by 'an. educational agency can be 
of value in determining a need for improvement and develop- 
ment. For example, a guidance staff / throuah analyzing the 
reasons given by graduates for not finding related llork, m 
could discover a !\eed for group counseling and/or irrjroved 
30b placement services. If a large portion of graduates 
indicated that they learned after leaving the program that ' 
the field offered little opportunity for advancement', J:he • 
staff could take steps to remedy the situation by having 
ninth or tenth graders take a short seminar on occupational 
mtpbility and career paths. If some gradua-tes indicated they 
discovered on the job that they did not like the pay or the 
working conditions, the- staff could plan tours of local 
factories and companies and provide information on prevailing 
wages for occupations in the area. 

Sometimes the results of follbw-up 'studies ^can indicate 
the need for services not presently provided. For example, 
in responding to the question, "How did you get your first 
full-time jdb after ^radu&tion?" only a small proportion of 
former students might have indicated instructors, other 
school or college personnel, or the state employment agency 
as sources of jdb leads. The graduates might also have said 
that It took them three to -five months to get jobs. This 
information makers it apparent that the educational agency, 
should consider supporting a job placement service. . 

* * 

Often the results of a follow-up s.tudy indicate that a 
proportion of the graduates" moved out of the area to find- 
work. An educational agency finding a 'large percentage of 
its graduates leaving the area after graduation should con- 
sider developing a special task force to take several steps: 

1. Develop a placement service -^o help former students 
find suitable employment both within and outside 
the immediate area. 

2. Determine if there is. a low local labor demand. 

If this IS the case, then programs should be revised 
to reflect the area's occupational opportunities. 
If this IS not the case, then programs should be 
revised to reflect more closely the knowledge and 
skills required in the community. 



3. Establish periodic meetings wi'th students and their 
parents to acquaint them with information on local 
labor market conditions', if these are poor,"- 
students and psirehts should be advised to consider . 
the need^to workS^in another labor market area after 
the students leavle school. 
I • , ^ ' ^ . 

i Follow-up results can have value ^as indicators of needed 
services not presently provided o^ as indicators of a need 
to expand ■^@xist°ing services, fince the development or 
improvement of student services can- often be initiated with- 
out any additional personnel or cost, decisions related to 
such services can often be readily implemented. Following 
the indications of follow-up studies in this area can have 
the added advantage of making the students and parents aware 
^that the educational agency is making concerted efforts to 
provide for the total needs ' of the students. 

Other Uses of Fdllow-up Information . 

' Generally, the primary users of a follow-up report are-s^ 
the' local educational agency and the community. Other users^ 
of this information are; 



1. - Local advisory colincil 4 

2. State advisory council 

3. State Department ^f Education 

4. U^-S. Office of Education 

Each of these agencies has a different interest in and use 

for the follow-up report. Each exerts a different kind of* 

influence on the decisions a local educational agency may 

make . * • ' 

A local advisory council is concerned primarily with 
what the* follow-up results may mean in terms of specific 
program or course content. The unique contribution such a 
'group can make stems from their knowledge of industry's 
requirement for specific skills. For ekample, the council 
can help to determine whether changing skill requirements 
are causinq /tewer former students to find work related to 



their training.] Local advisory councils can also be helpful 
in detormin i?VQ^he accuracy of conclusions related to program 
offerinqs vind in reinforcina recommendations related to 
programs. 
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The ftate advisory ^council, by. contract, is concerned 
with broaS policy matters related to the effectiveness of ^ 
programs. A local, follow-up is s.een by this group as an 
accounting of the effectiveness of Ibcal programs in meeting \ 
both the needs of students and 'the intent of. federal legisla- 
tion.. ,Whi4e the state advisory council cannot determine 
policir^, it does send pc^licy recommend^ions directly to the 
StateSBoard of Educaton. The council's most cdmmon recommen-^ 
dations based on local follow-up studies relate to: 

1. J Approving new, programs 
\ 2. Evaluating existing programs in terms of: 

a. labor market needs 

b. student heeds . , 

. • .. <■ • 

3. Long-range planning '. ' , 

4. Eliminating, sex or race' bias *in .programs 

* _ ■ ■ 't - • 

5. Coordinating programs between different ' 
educational levels ^ • , 

6. .Tnservice training of • instructors on new 
occupational ski^ll requiremelTts 6 • 

The State Department of Education is'^e administrlCor 
.of the regulations established by the State^oard of Education 
Its authprity is derived from the State- Boari The State. 
Department recommend^g new policy, recommends phanges in 
existing policy, and implements policy. Local foi'low.-up 
results can be used by the State, Department. oJ/Education to: 

1. ^ Validate its sample follow-up of former vocational 
students 

* 2. Aid -in determining -the effectiveness of local 

programs 

3. Develop criteria for future funding from either 
federal or state monies 

> 

/ 4. Recommend new policy and policy changes to the State 
Board of Education 
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. Cfhe U.S. Office of Education, ad the' administratoir o^f 
^^^dez;al legislation, develops regulations and conducts audits 
r^^^ding the use of federal monies at '^tate and local levels.' 
The y,S. Office ^an use local 'follow-ups to assist in deter- 
minMg 'd) hdv adequately federal monies were used at the 
stati?. and local levels in carrying out the intent of the 
law and (2) what amount of federal funding should be all6cated 
to ithese levels in the -future-^ Thus, the results of follow-up 
4r@ a k^ey factor in. the^ asse'ssment , at the federal level, of 
the success of vocational education. Obvixsusly, State emd 
Ipcai educational agencies tnust be concernl^ abbut the results 
of follow-ups if they do not wish to jeopardize federal 
support of vocational education at their levels. 

In summary, if is clear that follow-up studies and 'the 
data they generate ate 6f interest,^to a wide- audience... Jf 
Figure 6-2 identifies institutions^at various levels that can 
use fallow-up iriformation, basic ways in which they might 
use that information, and methods commonly used to gather 
that information. Figure 6-3 suggests some helpful hints 
for presenting the information to all ,t he. audiences who 
might profit form it. * 
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Figure: &2 Utitiiaticm of Fallow-Up Information 
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thVervievft 
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Faeton to Contkkr When Pretentina Fotlowmp Infofmstton 

• ■ .. ■ 

—5 ' ■ ■ ■ ■ 

# A - <, ...... 



1 . Present data to^Mmany appropriate groups and individuals as possible, and hiahliaht 
critical data on Mciar populations. , ' ' ^ 



Go through the prppiw<chaln of contmamJ when presenting data to a school board 
or bQ^rd of trustees, superintendent or president, adnfilnlstrators. etc. 

3. Present the {^.formation to the appropriate administrator In a school or college. 

Remember <hat, although many follow-up reports are prepared for boards of education, 
most utilization of the information occurs at the school or program level. 

W.^'^y'^ ^° teachers, where applicable. When data indicate a problem, many 
tif^ It can be solved by going directly tp the heart of the problem (teacher. 
priTTclpal, pr^ram mana^). 

• . ' - • 

5. When nwking oral presentations, cover areas most Important to the audience and 
discuss them as thoroughly as necessary. " 

6. Send an acMmpanyIng form with follow-up reports to be filled Ih by the recipient 
, *, ^f the reborrowing who^used the data for what. how. etc. This is an excellent 

way to identify who Is using the data. 

7. A4ake use of the public media. A considerable amountof public relations is 
involved with the presentation phase of the follow-up process. 

8. Si nee reports in'^olve data comparisons, have state, d istrict, and institutional data 

* available for some presentations. Make sure that copies are available for everyone, 
if possible. Avoid school-to-school comparisons. 

9. When presenting information to a board of education, report only the sheets that 
are of immediate interest. Do not include foliowrup information-notrSated^o 
board policies. • ^ 

\* 

10. Remember that follow-up data are relevant to individuals in many agencies: ^ 
Chambers of Commerce, State Employment Services, and Comprehensive 
Employment and Training Act prime sponsors. 
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GLOSSARY* 



Some of the key terms used in the folJxw-up study ^lude 
clear and precise definition. Tho^e definitions that follow 
^ are intended to clarify the overall focus on the' follow-up 
study but go be^nd the definitions ntffeded in doing °a follow - 
up study . Moreover, they are identified as a "definitional — 
base" for the comprehensive evaluatioh of vocational educa- 
tion, of which follow-up studies are an integral part. They 
are not "carved in stone" and should not be interpreted ' so as 
to foreclose alternative, potentially,. valuable definitions.. 

However, the definitions that follow pertain to all \ 
sections of the iEducational Amendments of 1976, Title II, 
Vocational Education. They were taken frbm "the Act" itself 
(in particular Part c - Definitions) and .Appendix A — 
Definitions as they\ippeared. in the Rules and Regulations, 
Federal Register , Vol. 42, No. 191 -.Monday, October 3, 1977. 

• • ^ 

Categorical definitions pf handicapped were taken from 
the Rules and Regulations that implement Part B of the 
Education of the Handicapped Act (as requited by the Educa- 
tion, fgr All liandicapped Children Act of 1975) Federal 
Register, Vol. 42, No. 136.- Tuesday, August 23, 1977. Other 
definitibhs were takeh from the Vocational Education Data 
System (VEDS) 'that has become the review version being 
examined 'in the Offi'ce of Education (OE), and by the Office 
.of Management and Budget (0MB). Therefore, the definitions 
that follow are not necessarily final. 

• ♦ 

Definitions related to corrections, such as those for 
offender and yputh offender, were taken from the following 
% source?- Searph Group , irsc . , u. S . Departmeht of Justice , 
Law Enforcement Assistance Administration, National Criminal 
Justice Infopnation and Statistics Service, Dictionary of 
■Criminal Justice Data Terminology . First Edition, 1^7^, 
pp. 66,97. ' ■ 



Source: Marion Franken, "Providing Technical Evaluation 
Services for Educational Agencies," mimeographed (Coiumbus 
Ohio: The National Center for- Research in Vocational 
Education, The Ohio State University, 1978), pp. 15-27. 
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Act: Th© Vocational Baucatiqn Act of 1963, Public Law 88-210, 
as amended by Title II of the' Education Amendments of 1976, 
Public Law 94-482, 90 'Stat, 2168, 20 U.S.C. 2301 ^t seq. 

■ ' ' •/ • ' ''^ I . ** 

Administration ; Activities of a state or an eligible 
recipient necessary for the proper and efficient performance 
of its duties under the Act , including ^supervision, but ndt 
< including ancillary services. ^ ' 

Adult as it pertains to long-term adult s A person enrolled 
' in any program. not classifiable either under eleventh- and 
twelfth-grade levels or as postsecondary. Persons enrolled 
• in a prbgram of at least 500 contact hours duration leading 
to new, occupation preparation will be reported here. Persona 
registered either by the federal or state government and cur- 
rently enrolled in a related course leadi^fig to journeyman 
status (apprentice program) will also be reported here. 

Adults as it pertains to .short-term adult : A person enrolled 
in any program of less than 500 contact hours. , ' 

Adult prograw : A vocational education program for persons who 
have already entered the labor market or^who are unemployed 
or who have completed or left' high school, and who are pot 
described in %he definition of "postsecondary program." 

American Indian or Native Alaskan : A person having origins 
in any of the original peoples of North i^erica or main- 
taining cultural identification through tribal affiliation O 
or community, recognition. ^ ' ' * j 

Ancillary services : A£:tivities which contribute to^ thfe 
enhancement of quality in vocational education programs, 
including activities\such as teacher training and curriculum 
development but excluding administration (except in consumer 
and homemaking educatidn under Section 150 of the Act) , 

Area vocational- education school ; (a) A specialized high 
school used exclusively or principally for the provision of 
vocational education to persons .who are available for study 
in preparation for entering the labor market; or (b) the 
department of a high school exclusively or principally 
used to provide vocational education in no less than five 
different occupational fields to persons who are available 
for study in preparation for entering the labor market? or 
(c) a technical or vocational school used exclusively or 
principally for the provision of vocational education to 
persons who have completed or leftp high school and who are 
available for study in preparation for entering the labor 
market? or (d) the department or division of a junior college 
'or community college or university operating under the 
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• policies of th© State Board which provides vocational educa- 
tion in no less than five different occupational fields, 
leading to immediate employment but not necessarily leading 

*• to a baccalaureate degree, if j (1) The vocational programs 
are available to all residents of the state designated and 
appepved by the State Board? and (2) In the case t^f a 
schJol, department, or division described in (c) or (d) , 
it a,dmits as regul'ar students both persons who have 
completed high school and persons who have left high school. 

Asian or Pacific Islander : A person having origins in any 
of the original peoples of the Par East, Southeast Asia, 
the Indian subcontinent, or Pacific Islands. This area 
includes, for example, China, Japan, Korea, the Philippine 
Islands, Samoa, India, and Vietnam. 

. ' ■ * 

Bilingual vocational training : Training or retraining in 
wnich instruction is. presented in both .the English 
language and the dominant language of the persons receiving 
training and which is conducted as part of ' a program d6- 

* signed to prepare individuals of limited English-speaking 
.ability for gainful employment as semi-skilled or skilled 

/workers or technicians or subprofession^ls in recognized 
/ occupations and in new and emerging occupations, but ex- 
cluding any prbgram to prepare individuals for employment 
in occupations which r.equire a- baccalaureate or advanc'ed 
degree? bilingual vocational training includes guidance and 
counseling (either individually or through group ins true- • 
tion) in connection with such training or for the purpose 
of facilitating occupational choices? instruction related 
to the occupation or occupations for which the students 
. are in training or instruction necessary for students ^ 
to benefit from such training? the training, of persons 
engaged as, or preparing to^ become, instructors in a bi- 
lingual vocational ""training' program? and the acquisition, . 

maintenance, ^nd repair of instructional supplies, aids, 

and equipment, but such term does not include the construc- 
tion, acquisition or initial equipment of buildings or the 
acquisition or rental of land. * ^ • 

B lack, not of Hispanic Origin : A person h4ving origins in 
any of the l:^lack racial groups of Africa. 

' . V ** 

CETA: The Comprehensive Employment and Training' Act of 
1973, Public Law 93-23, 87 Stat. 839, as amended. 

\ 
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Completed program : A student who finished a planned sequence 
of courses, Services or activities, designed to meet- a voca- ^ 
• tional occupatipnal objective and which purporfs to teach - 
entry-level job skills. Includes 6x\ly those persons in 
secondary, postsecondary, and long-term adult programs. 
Report these persons unduplicated by race/ethnic group by 
sexi' level, and handicap as previously defined. (Federal 
Regulations, October 3, 1977, Part VI). , * 

Consumer and homemakinq education programs : Programs that, 
consist of instructional programs, serviceis, and activities 
that at all educational levels for the occupations of home- 
making including: (1) comprehensive homemaking;; (2) child 
development and guidance; (3) clothing and textiles; (4) 
consumer" education; (5) family healthy (6) family living 
and parenthood education; (7) food and nutrition;. (8) 
home management; (9) housing and home furnishings'; ^iti 
(10) other. ' : 

Cooperative. educati6n (unduplicated) : A program of vocational 
education for persons who, by written cooperative arrangements . 
between sdhool and employers, receive instruction, including- 
required academic courses and related vocational 'instructions- 
by alternating study in school with a job in any occupational . 
field. These two experiences must be planned and supervised ^ 
by the school and employers so that each contributes to the 
person's education and his or her employability. Work periods 
and school attendance may be on alternate half days, full 
days, weeks, or other periods of time in fulfilling the coop- 
erative program. - , " . , 

Curriculum material's : Materials: (a) covering instruction 
in a course or series of courses in any occupational 'field, 
atid (b) designed either to prepare per*sons for employment at 
the entry level, or (c) to Upgrade occupational competencies 
of those previously or presently employed in any oc9upational 
field. 




DiB.advantaqed: - Persona (other than ""fiandi capped) who 'meet *' 
the following criteria: 

• . * * * • 

Economic disadvantaged: (1) Family income .is at or 
below national poverty level; (2> Participant or 
parent(s) or guardiqi of the participant is 'unemployed; 
(3) Participant or parent of participant is institu- 
tionalized or under state guardianship.. Operationally, 
economic disadvantage can be determiiied by reporting 
students, at the secondary level who are participating 
in a free or reduced APDC (Aid to PamiXies of Dependent 
Children) lunch .prograij,^ or work-study program,* and 
students at the postseeondary or l^g-tei-m adult 
. ^. levels may be identified from basic education opportuni 
ty grants records .or similar financial ai-d. 

Academic disadvantaged: Indicated by: (1) lack of 
. reading and writing skills; (2) lack of mathematical 
skills; or (3) performance b'^low grade level. Opera- 
tionally, academic disadvantage caa be detetmined at 
the secondary level by reporting students enrolled in * 
remedial programs, or performing- below grade, level on 
standardized tests or failing a. grade and for the ppst- 
secondary and long-term adult levels by reporting stu- 
dents enrolled in remedial instruction or an aeademic 
probation. Substantive evidence' of disadvantage must 
• • be kept on file. . - 

Displaced homfemaker : Persons who meet the following defi- 
nitions : (a) persons who had been homemakers but' who 
now, .because of dissolution of marriage, must seek em- 
ployment; (b) persons who are sxngle heads of households 
and who lack adequate job skills; (c) persons who are 
currently homemakers and part-time workers but who wish to 
secure full-time jobs,; and (d) .women who are now in jobs 
which have been traditionally considered jobs for fe'males 
and who wish to seek employment in job areas which have not 
been traditionaUy considered as job areas for females, and 
men who are now in jobs which have been traditionally con- 
sidered jobs for males and who wish to seek employment in 
job areas which have not been traditionally considered as 
job areas for males. 



El igible recipient : * (a) a local educational agency, or 
a postseco'ndary educational institution. 



I 

Enrollme nt of handicapped by type^of instructional settincf j 
To De reported 'only once, by insinictional setting of program 
in which ° enrol led. Instruct iojial setting of program should 
be indicated as either regular, mixed, separate program, 
separate facility, or other. 

Regular program: One which is conducted in an inte- 
grated setting, i.e., with handicapped and nonhandicap- 
ped students togeth^. A handicapped student should be 
reported in a regul#u4>rogram if that student experiences • 
full participation -m^ regular vocational education 
program. If added support services are provided to 
assist a student, he/she should "be reported under the 
regular programs provided those services are in addition 
to full participation in the regular program. 

Mixed program: A program in which handicapped students 
participate in both regular and separate instructional 
settings. The handicapped person participated part- 
time in the regular instructional setting. 

Separate program: A program in which the handicapped 
person is enrolled at a regular institution in a . 
vocational education program that is designed for and 
limited to handicapped students. 



Separate facility: A facility in which the handicapped 
. student is enrolled full-time in a vocational education 
program that is designed for and limited to handicapped 
students. 

Other: Vocational education program activities provided 
to handicapped students in hospitals or at the homes 
of the students. 

• 

Gifted an d talented ; Children identified by professional 
qualified persons, who by virtue of outstanding abilities are 
capable of high performance. These are children who require 
differentiated educational programs and/or services beyond 
those normally provided by the regular school program in 
order to realize their contribution to self and society. 
"Hiqh performance" miqht be manifested in any or a combina- 
tion of these areas: (I) general inteiliqence; -(2) creative 
or productive thinkinq; (3) leadership ability; (4) visual 
ana performing arts; and (0) psychomotor ability. 
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Handicapped children ; (a) As used in the pfrt, "handicapped 
children" means those children- evaluated in accordance with 
subsections 121a. 530'- 121a. 534 as'being mentally retarded, 
hard of hearing, deaf, speech^ impaired, 'visually handicapped, 
seriously emotionally disturbed, or'tbopedically impaired, 
other health impaired, deaf-blind, multi.-h^andicapped, or as 
having specific learning disabilities'., vho because of those 
impairments need spa4ial education and telated, services. 
For ^VEDS reporting {Jurposes at the secondary .level,, report 
all handicapped persons enrolled in voca'tional education^ 
programs who have an Individualized E^^catioA Plan (IEt>) ^ 
as prescribed un4gr Public Law 94-142, For (^reporting 
purposes for postsecondary and long-term adult vocational 
education programs, a ^handicapped person is'^a person who ^ 
has a physical or mental impairment. Substantive evidence 
of handicapping condition must be jsn file either from medical 
records or,^whexe appropriate, by .psychological (and/or 
physiological) diagnosis. (b) The terms used in this 
definition are defined as follows: 

^* » A hearing impairment which is so severe that 

the child is impaired in processing linguistic 
information through hearing, iVitK or wi|:hout am- 
plification, which adversely affects educational 
performance. 

2. Deaf-blind ; Concomitant hearing and /isual impair- 
ments, the combination of which causes such severe . 
communications and other developmental and educa- 
tional problems that they cannot be accommodated in °. 
special education programs solely for deaf or blind 

• children. 

3. H ard of hearing ; A .hearing impairjnentf whether 
permanent or ^ fluctuating , which adversely affects 
a child's educational performance but which is not 
included under the definitions of "deaf" in this 
section. ' 

^' Men tally retarded ; Significantly subaverage general 
intellectual functioning existing concurrently with, 
deficits in adaptive behavior and manifested during 
the developmental period, which adversely affects \ 
a child's educ^ti,onal performance." 

Mu 1 1 i-handicapped ; Concomitant impairments (such 
as mentally retarded-blind, mentally retarded- 
orthopedically impaired, etc.), the combination of 
which causes such severe educational problems 
that they cannot be accommodated in special oduca- 
t ion programs solely for one of the impairments , 
Tfio t.Grm does not include deaf-blind children. 
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Qrthbpedically impaired t A severe orthopedic impair- 
ment which adversely affects a child's education 
perforinance. ',The term includes impairments caused 
by congenital anomaly (e.g., elubfcot, absence qf 
some member, etc.), impairments caused by disease 
(c.'g,, poliomyelitis, bone tuberculosis, etc.), 
and impairments frqm o1;Her, causes (e.g., cerebral 
palsy, amputations, and fractures or burns which 
cause contractures) , ' . 

Qther health impaired ; Limited strength, vitality 
or alertness, due to chronic or. acute health 
problemrs, such as a heart condition, tuberculosis, 
rheumatic fever, nephritis, asthma, si6kle cell 
anemia^ hemophilia, epilepsy, lead pqisoning, 
leukemia, or diabetes, which adversely affects a 
child's educational performance. 

Seriously emotionally disturbed ; A condition 
exhibiting one or.moys of the following characteris- 
tics over a long period of time and to- a marked 
degree, which adversely affects educational, per fof- 
mance: (A)^ An inability to learn which cannot be 
e^cplained by * intellectual , sensory, or health fac- 
tors7 (3) An inability to build 9r maintain satis- 
factory interpersonal relationships with peers and • 
teachers; (C) Inapprb^riate typ,es of behavior or 
feelings under normal citcumstances; (DJ A general 
pervasive mood of unhappiness of depression; or 
\e) A tendency to' deyjelop physical systems or fears 
-Associated with personal or school problems. (ii) 
The term includes children who are schizophrenic^ 
or autistic. The term does pot Nine lyde children 
who are socially maladjusted, unless it is determined 
that they are serioi^isly emotionally disturbed. 

Specif'ic learning 'disajpility ; A disorder in one or 
more of the basic psychological processes involved in 
understanding or infusing language ^jspoken or written, 
which may manifest Itself »in an imperfect ability 
to listen, think, speak, read, write, spell, or to 
do mathGrnat^cal calculations. The term includes such 
conditions as perceptual handicaps brain injury, 
minima] brain disfunction, dyslexia, and developmental 
aphasia. The term does not include children who 
have learning problems which arc primaril^^ the result 
of visual, hearing, or motor handicaps, of mental 
rotardat; ion , or of onvi ronmental , cultural, or 
' M'onom ii.' d i uadvaiU a-}».> , 



Speech impaired : A coiranunication disorder, such 
as stuttering, impaired articulation, a language 
impairment, or a voice impairment, which adversely 
affects a child's educational per'f ormance. 

' Visually handicapped i A visual impairment which, 
evenwitn correction, adversely affects a child's 
education performance. The term includes both 
partially seeing and blind children. 

• 

High school program ; Vocational education for persons in 
grades nine througfi" twelve. 

♦ • • 

Hispanic ; A person cf Mexican, Puerto Rican, Cuban, 
Central or South American, or other Spanish culture or i 
origin, re.qa'rdless of race. . * 

\ i 

Industrial &rts education programs : Those education programs 

whic^ pertain to the body of related subject matter, 
or related courses, organized for the development of under-- 
standing about all aspects of Indus cry and technology, 

• includfing* ■•learning experiences, involving activities such 
as experiment^; designing,, constructing, evaluating and 
using tools , /machines , materials and processes; and (b) 
which assist-Undividuals in making informed and meaningful 
occupational choices, which prepare them for entry into 
advanced trade and industrial ot; technical education proqrams. 
(Section 195 (15); 20 U.S.C. 24^1) . K ' . . 

I^avtirs: Anyone who has been ^ittol led and attended a program 
of vocational education and has left the program or institu- 
tion without cpmpleting the program,- including persons who 
leave the program voluntarily before its formal completion 
bocause they have' acquired sufficient enti;y-level occupational 
prppnration to work in the fie^d, and who have taken a job 
rolat*-.! to their field of training and, all other leavers. 
'vl^is count should include all persons who left a^program 
whoso status was documented during the reporting year. 
Ko.r oxampl^; i^^ person .\^ho left in ^une 1979, but was i^ot 

• locumonted unlil the following September would be reported 
in ♦:hf- l«^.7 9-80 reporting cycle. Report these persons by 
r.ac(- . ethnic group, by sex, level of completion ' for persons 
wh(j Irft after completincr more than 50 percent of the program, 
mJ \or torsons who left before completing 50 percent or less' 
•t pi-f.cTr.-'m, and handicapped. 
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Limited English-speaking ability > When used in reference to 
an individual meahs: (a) Individuals who were not born in 
the United States or whose native tongue is a language other 
than English, and (b) Individuals who- came from environments 
where a language other than English is dominant, and by 
reason H thereof, have difficulties speaking and under- - 
standing instruction in the English language. . 

Lo cal - educational agency ; (a) A board of education (or 
other legally constituted local school authority) having 
administrative 'control anc^ direction of public elementary 
or. secondary schools in a city, county, township, school 
district, or political subdivision of - a sta.te; or Cb) Any 
other public educational instit'uibion'^or agency having 
administrative control' and direction of a vocational 
educational' program. 

. ( ■ ■. , . 

Lbw-income family or individual ; Feunilies or individuals 
who are determined- to be lowrincome according to the latest, 
available data from the Department of Commerce. 

O ccupat^nal p^^aration programs ; ' 'ProgramsA designed to 
Impact competencies to persons to prepare tnfem for employ- 
ment -{paid or unpaid) in a specific occupational field. 

«. ' ■ . 

Offender ; An adult who has beeh convicted of a criminal 
offense'. Defining f enures include; (1) identified adult, 

(2) charged with a criMe by a criminal justice agency, 

(3) convicted. . :> \ • . • ) 

Other occupational programs ; (to be reported by two- 
digit OE code)>i. Enrol Iments in a program or activity below 
the eleventh grade level, courses prerequisite to a six- 
.<4.igit OE code program or a course or activity that leads 
to more than one six^digit progremrj. 



i'ostsecondary students ; Persdhs enrolled in vocational education 
programs to whom" credit is given toward an. Associate Degree. 
Persons who are pursuing a certificate or license rather* 
than an Associate Degree even though they may be concurrently 
ki^jiving credit toward an Associate Degree shall be 
cLassifitJd adults. 

ro^t se condary educational institution; A nonprofit institu- 
tion' Tb'^i I ly authori-^ed a state -to provide education for 
persons sixteen years of or "older who have graduated from 

or left elementary or secondary school. 



Postsecondary proc^ram ; Vocational education for persons who 
have completed or left high school and who are enrolled in 
organized programs of study for which credit is given toward 
an associate or other degree, but which programs are not 
designed as baccalaureate or higher degree programs, 

« 

Private vocational training institution ; A business or 
^^^^Q school, or technical institution or other technical 
or vocational school, in any state, which Ca) admits as 
regular students only persons who have completed or left 
elementary or secondary school and who have the abili^ty to 
benefit from the training offered by such institution; / 
(b) IS legally authorized to provide, and provides withinA; ^ 
that state, a program of postsecondary vocational or techai\al 
education designed to fit individuals for useful employment * 
m recognized occupations; (c) has been in existence for 
two, years or has been specially accredited by the Commissioner 
as an institution, meeting the other requirements of this 
subsection; and (d) is accredited (l) by a nationally 
recognized accrediting agency or asgjociation listed by the 
Commissioner pursuant to this clause, or (2) if the Com- 
missioner determines that there is no nationally recognized 
accrediting agency pr associatipji qualified to accredit ^ 
schools of a particular categoric, or (3) if the Commissioner 
determines that there is no nationally recognized or state 
agency or association an Advisor^^ Committee appointed by 
him/her and composed of persons specially qualified to ' 
evaluate training provided by ^schools of that category, 
which commijitee shall prescribe 'the stan<^rds of content, 
scope, and quality which must be met by those schools and 
shall also determine Vhethet particular schools meet those 
standards. For the purpose of this paragraph, the Commis- 
sioner shall publish a, list of nationally recognized 
accrediting agencies or associations and state« agencies 
which he/she determines to be reliable, authority as to the 

• lability of education or training afforded. \ 

f ' ' 

rj:?S.^i]}- A planned sequence of courses, services, or other 
edugat^onal activities, eleventh grade and above, desiWied 
to moot a specific vocational objective ( s) ,. 

J^^:0'jr_^y^..5P.?ipi£ter: A student who finished a planned sequence 
ot courses, services, or activities which p.urports to' teach 
'^:\' rv-\cvr\ job skills designed to meet an occupational 

• • -f 1 \'o . , » 

Pr.. >.j»a\n '*nro lj.m_Gnt : Enrollment will be counted upon official 
•M'.tranu'e into an eleventh grade loycl vocational education 
f r o jr..-im f'>r which a vocational ot:)|ectivG can bo stated or 
ir.: 1 ; ....I . 
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Related services ; Includes transportation and such develop- 
mentals^corrective and other supportive services &s are 
required* to assist a handicapped person to benefit from the 
^vocatio;\al education progrlnfev such services include speech 
pathology and audiology, psychological services, physical 
occupational therapy, recreation, counseling services, 
anl medical services for diagnostic or evaluation purposes. 

School facilities ; (a) Classrooms ^and related facilities * 
(including initial equipment and interests in-i^nds on which 
such facilities are constructed), (b) "School facilities" 
does not include any facility intended primar±W for events 
for which admission is to be charged to the genital public. 

Secondary program ; Vocational education fxDr persons in 
secondary grades as defined by state law. 

{ . - . ■ ^ ■ 

Sex bias ; Behaviors resulting->f rom the assumption that one 
sex is superior to the other. 

Sex discrimination ; Any action which 'limits or denies a 
person or a group of persons opportunities, privileges, 
roles, or rewards on the basis of their sex. 



Sex stereotyping ; Attributing behaviors, abilities, interests 
values and roles to a person or group of personst^n the, basis 
of their sex , 

Sho]^t-terTn adult enrollments; Enrollments -XR adilt voca- 
tt 
hou 



on^l education for programs of less than' 500 contact 
ursi duration, . . ' , * ' • 

Special educational assistance ; Specially designed instruc- 
tion and aids to meet the ilhdiyidual needa of a handicapped 
student; such aids may include teachers' ai^s to 'support 
classroom or lab instruction, taped texts, interpreters or 
other effective methods of making orally 4elivered materials 
available to stud'ents with hearing impairments, readers in 
libraries fot 'students with visual^ impairments, classroom 
equipment adfipted for use by students with manual impair- 
ments", and other similar services and actions, as well as, 
faaility modifications, 

^P£^.i?_L_ni:£5?£ ' Persons who meet the requirements under the 
'law for one of the categories (handicapped, of limited 
i;ng 1 ish-spoaking ability, disadvantaged Economic and 
acadcmiq) ) whether or not special services are provided by 
vocational education per so. 



• ^N. A * ■ " ' 

, ' Special needs rtiy<uplicabed) ; Enrollment cqunts of persons 
who are handicapped)) of lifnited English-speakihg ability or 
disadvantaged (ecpnomic or academic)-, regardless of whether 
or not special services are being provided by vocational * 
education per s@. A person must be listed under only o.-ie 
type of special) needs category. When a person enrolled has 
more than one special need, they are to be reported uh- 
duplicated in this order: handicap^d, of«- limited English- 
speaking ap^idrty, disadvantaged (ieconomic or academic) . 

f ' ' . ' ' 

State: Includes: (a) -The fifty states; '.(b) The ..District 
of Columbia? (c) The Commonwealth of Puerto Rico; (d). The 
Virgin Islands; (e) Guam; (f) American Samoa; and (g) ' 
The Trust Territory of the Pacific Islands. 

State board ; ^ The state board designated or created by 
state law as the sole state agency responsible for: (a) 
the administration of vocational education; or (b) super- 
vision of the administration of vocational. education 
in the state. 

State edu cational agency (SEA) : ta) The state board of 
education; or (b) Other agency or off ice "primarily responsible 
for the state supervision of public elementary and secondary 
schools; or (c) If ther^ is no such office or agency, an 
offi.ce or agency designated by the Governor or by state law. 

Suppo rt services for women ; 

Counseling: Counseling women entering and enrolled in 
nontraditional programs on the nature of these programs 
and on the ways of overcoming the difficulties which 
may be encountered by women in these programs. 

Job development: Programs and activities in the area 
of job development include. the provision of materials and 
information concerning the world of work which present 
women students entering, enrolled in, or interested in 
nontraditional programs, the options, opportunities, and 
rancje of jobs available in these nontraditional fields. 
..'ob development support services may also be carried 
cTut through bringing persons employed in these non- 
traditional fields into the schools, as well as providing 
. ■.opportunities for women students to visit the workblace 
•jf business and industry so as to afford them a clear 
iiridcrstandincj of the nature of the work, including an 
understanding of the work setting in which these jobs 
.in? performed, 
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Job follow-up support: Services to assist women . 
student 8^ in finding, employment relevant to their 
training and interests. Follow-up services may be 
provided to assist students in the work force and 
to deal with barriers which wdmen face in workinq 
in nontraditional areas, ^- 

Training of women instructors: Funds may be Used to 
increase the number of women instructors involved 
in the training of individuals in programs which 
have traditionally enrolled mostly males, so as to. 
provide supportive examples for these women who are 
preparuiq tcr jobs in nontraditional areas of 
eritjiOiinent . 
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Terrni iiatlcns (unduplicated) : "Completed Program" means a 
stu3ent who finished a planned sequence of courses, services, 
or activities designed to meet a vocational occupational 
objective and which purports to teach entry-level job 
skills. Include only those persons in secondary, post- 
secondary and long-term adult programs. Report these persons 
unduplicated by race/ethnic group by sex, level., and handi- 
cap, as previously defined. (Federal Regulations, October 
3, 1977, Part VI) . 



Trans^^r? : Persons who left vocational education prodisams 
to enroll- (a) m other vocational education programs or 
(b) rn programs not related to vocational education, A 
count of transfers should include kll persons whosfe transfer 
status was documented during the Reporting year. For 
example, a person who transferred \n June 1979 whole transfer 
was not documented until the follotfind September wokld be 
counted in the 1979-80 reporting cfcle. «i oe 



Vo cational education ; Organized Educational programs which 
are directly related to the preparation of individuals 
tor paid ,or unpaid e'mployment or for additional preparation 
for a career requiring other than a baccalaureate or advanced 
doorroe. For purposes of this paragraph, v the term "organized 
education program" 'means only: (a) instruction related to 
the occupation or occupations for which the students are in 
training or instruction necessary for students' to benefit 
{ rom such training and \h) the acquisition, maintenance, 
and repair of instructional supplies, teaching ai:"'3, and 
o'luipmont. The term "vocational education" does not mean 



t ho C':.ni3t.ru.'t ion, acqui-'sition, or initial purchase 
Inent tot • buildings or the acquiiMItion or rental of 




of equip- 
land. 



vocational instruction t Instruction which is designed to 
prepare individuals upon its completion for employment in 
a specific occupation or cluster of closely related oc-» 
cupations in an occupational field, and which is especially 
and particularly suited to the needs of those engaged in 
or preparing to engage in such occupation or occupations. 
Such instruction may include? (a) Classroom instruction; 

(b) Classroom related field, shop, and laboratory work; 

(c) Programs providing occupational work experiences, 
including cooperative education and related instructional 
aspects of apprenticeship programs? (d) Remedial programs 
which are designed to enable individuals to profit from 
instruction related to the occupation or occupatgns fo!^ 
which they are being trained by« correcting whate^r edudationaX 
deficiencies or handicaps prevent them from benefiting f^om 
such instruction; and (e) Activities of vocational student 
organizations which are an integral part. o"f the 'vocational 
instruction, subject to the provisions in 104.513, 

Vocational objective ; The intended occupational outcome 
of training and other preparation as statbd by ^the individual 
student or implied. The vocational objective usually is 
stated in terms of specific job titles, 

• 

White, not of Hispanic oric?in : A person having origins in 
any of the original peoples of Europe, North Africa, or' 
the Middle East, 

Youthful offender : A person, adjudicated in criminal court, 
who may be above the statutory age limit for juveniles but 
IS below a specified upper age limit, for whom, special cor- 
rectional commitments and special record sealing procedures 
are made available by statute, defining features include: 
(1) person adjudicated in criminal court; (2) judicial pro- 
ceedings began in criminal or juvenile court; (3) defined 
a youthful offender in accord with a statute stating age 
limits, and; ( 4) • oroviding special correctional commitments 
and/or record sealing procedures. 
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ANNOTATED BIBLIOGRAPHY 
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I^^TRODUCyiON . ■ 

This annotated bibliography identifies selected 
docuiaents that may be useful to you as you design and' 
implement. a follow-up system for special populations. 

The abstracts have been organized into four sections: 

o Limited English Speaking and Ei lingual 

o Women ^ 

o Disadvantaged and Mi^norities 
o Handicapped 
o Miscellaneous 

These documents were identified from a computer search 
of Abstracts of Instructional Materials (AIM) /Abstracts 
ci\^ Research Materials (ARM), Psychological Abstracts, 
Sociological Abstracts, dissertations, and 'Educational 
Resources Information Center (ERIC). In addition, 
periodicals and special publications from the holdings 
of the Research Library at The National Center for Research 
in Vocational Education were included. 

The Abstracts 

Each abstract contains a brief summary of the resource. 
ERIC Document numbers are provided for selected documents. 
It is also important to note that any abstract coded by 
a single asterisk was adapted from the abstract in the 
ERIC system while any abstract coded by a double asterisk 
(**) was obtained from Harrington, Lois, et al. Competency 
Based Staff Developm e nt: A Guide to the Implemen iatxon . of 

Programs lor Post-secondary Occupational Personnel 

(Columbus, Ohio: The National Center for Research in Voca- 
tional Education, 1978, Workshop Edition). 
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ANKOTATSD BIBLIOGRAPH^Y 

• * • * 

Limited English-Speaking and Bilingual Students 

\ ' , . ' • ' 

Berry, Dale W. , et al. Asseasment of the Status of Bilingual 
Vocatipnal Trainir^g for Adults . Voluite I: Assessment 
Report . Albuquerque, New Jflexlco: Kirschner Associates 
Inc., 1976'. (ED 131 68'1)*' 

This portion of the thr fee- volume' report outlines the 
need for bilingual vocational training (BVT) , the legisla- 
tive and programmatic responses to the need, .and conclusions 
drawn from. the a^sessm^nt of BVT programs. The appendices^ 
contain a detailed ' discussion oi procedures used for collect- 
ing data; the questionnaire administered to State Department 
of Education officials for compiling the program inventory; 
the program inventory, with detailed descriptions of BVT 
programs and mention of other related programs;^ and a chart 
summarizing, state-by-state, the program inventory and 
pertinent program characteristics. 



Law, Alexander I. Evaluating Bilingual Programs. TH 
Report 61 . Princeton, New Jersey. ERIC Clearing- 
house on Tests, Measurement, and Evaluation, ,1'!^ 77. 
(ED 138 645.)* 



• This paper is directed to those who ar^ undertaking 
evaluation of a bilingual program for the' first time or 
who have already struggled with the mysteries of such an 
undertaking. Emphasis is given to the reporting require- 
ments of the various federal and state funding agencies. 
The bilingual-bicultural program -structure is defined so 
the evaluator can see the interplay of program prototypes, 
student latiguage facility, and iiistructional approach. 
The evaluation process is divided into an explication of 
evaluation models, evaluation design , and instrumentation. 
Examples of each of these process components are given. 
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Women 

* * t * 

Leh.flann, Phyllis. "Cutting" Sex Bias Out of Vocational 
Education," The Education Digest . "XLIlt 33-35. 



This article . identifies efforts to reduce sex bias in 
several voca1;ional education programs. .The major programs 
reported include: The New Pioneers Project to Eli^minate Sex 
Bias in Occupational Education (North Carolina), which 
dS' trying to; change attitudes among st°ate vocational 
education staffees, guidance counselors^ and students; 
the ihtroduction to vocational training areas for ninth / 
graders at Eli Whitney Vocational High School (Brooklyn, ! 
New^ York*); and Project EVE (Texas), which is. designed to | 
inform young women of the lull range of job opportunities 
available and to recruit them for nontraditional programs.' 

■i 

I 

Bidder, Corinne H. , Women, Work, and Vocational Education . 
' Occasional Paper No. 26 .. Columbus: The Center for > 
Vocational Education, 1977. 



This paper discusses past and future trends in occupa- 
tional segregation of women in the. labor force. The 
trend toward occupational segregat^bn is supported by labor 
market information. The latter poft^on of the paper 
concentrates on "educational segregation by sex in voca- 
tional education and provides suggestions to vocational 
educators for altering these trends. 



Roby, Pamela Ann. Vocational Educatdon and Women ^ Santa 
Cruz, Californiil University of California, 1975. 

, (ED 112 155) 



•• This study focuses upon the role of women in vocational 
education., women's vocational education aeeds and the law, 
° and barriers to women in vocational education (e.g., 
a admission, t;nrollmcnt, instruction and .counselingj . The 
'■ final chapter provides a summary. The study's findings and 
recommendations for changes are applicable to federal .^aws, 
federal ari state policies a/id practices, local' edugat onal 
policies and practices, and research and development % .'forts. 
The paper contains 83 footnotes which may introduce the 
reader to other resources in this area. 

Steele, Marilyn. Women. in Vocational Education, Project 
Baseline Supplemental Report^ Flagstaff, Arizona: 
Northern Arizona University, 1974. 

This Project Base line* Supplemental Report presents 
stati-stical data on the status of women in the world of 
work and the status of vocational-technical education for 
females. It also "reports on sexism in society and educa- 
tion, staff-related problems foi- women in education and 
affirmative action for wcxnen in education and employment 
(includino an overview of pertinent legislctive" and executive 
actions) . The last section contains the implications for 
charuie in vocational- technical education. 



Disadvantage d and Minorities 

■ — '■ ' — ■ *«— - 



I,ockette> Rutherford E. and Lawrence F. Davenport. Review 
and Synthesis of Research on VocatiQnal Educatio;/i for 
the urban Disadvantaged . Information Series No.' 50, 
VT 013761. Colmnbus, Ohio: The Center for Vocational 
and Tochnical Education, The Ohio State University, 
1971. 

Tho publication identifies substantive problems and 
mothodological approaches for persons concerned with this 
important topic. It provides a review of ' research - 
finding^i which have application to educ^itional progrars. 
The specific contents ' include r (1) a historical perspective 
of vocational education for the disadvantaged, (2) a 
raeionalc for programs and characteristics of the disadvantaged 
li; rasearch on vocational education programs for the 
disadvantaged, (4) evaluation and discussion of the. 
research effort related to the disadvantaged, and (5) 
important considerations in developing and operating 
vocational education programs for the disadvantaged. 

i.iklanci, Thomas, od. ' Psychological and Educational 

Assessment of Minority "Children . New York: Brunner/ 
• haze 1, Inc., 1077. i 

This buck identifies various practices and'ussues 
which should 'bo considered in developing and providing 
-li.ujnost. ic services wi/th minority group childreii. The book 
I r. or.jani?:od to doscrifbe practices and issues frqim four 
dimennions: historical precedents, current standards set 
fort-.h hy professional associations, legislative Judicial 
i.'!:.ion, availal:)le technology, and ways to conceptualize 
I r,.TVif'o dol ivory model (using seven authors). In addi- 
Mon, th.oro ar**^ oiqht appc?ndicos which include, for example,' 
'^tliuMl fUand.irds for psychologists? selected portions from. 
• •t tndarJ.'^ for educational and psychological tests; and an 
inruTt.aftvl b i b 1 ) oc^raphy of lan<Tuaqe dominance measures. 
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Oak lief,. Charles; Review- -and Synthesis of Reaear ch pn ' 
Vocational a nd .Technical Education tor the Rural\ 
Disadvantaqbd. Informat^inn .gAr^pg ".rrp ^^-^n^^i-^ 

Columbus, Ohip; The Center for Vocational and 
Technical Education, 'The Ohio State University, 1971. 

\ ^ ■ 

The publication ,is an authoritative Analysis of the 
literature in the field of vocational' and technical edu- 
cation for the rural disadvantaged. The contents focus' 
on (1) the identification and description of the rural 
disadvantaged highlighting the demographic factors, *• 
ecological and economic factors, and family and social 
factors; (2) a rationale and provisions for vocational and 
tochnical education; (3, accessibility of vocat i^alUnd • " 
•tcichnical training; (4). innovative and exemplary programs; 
(o) trends in vocational and technieal" education ; and 
(0,) provisions to overcome special problems. 

r-.S. Department of, Labor. Workers of Sp anish Origin- 

A Charbbook, Bulletin 1970 . '. WashinShnn , n.r J — ' 

Governipent Printing Off.ice, 1978. 

I • ' ^ 

The content c|f this chartbook , ide^itif ies selected ' 
.•haractoristics of^ the Spanish-American population and 
labor force. The focus is pn two groups of Sp"anish 
oriqin: Mexican Americans -and Puerto Ricans. The data ■ 
ind information include: ' (D'sizeand composition of the 
labor force and labor force participation rates, (2) char- 
i^'t- ristics of the unemployed and their unemployment rates, 
w.) worK expof-ionco in '1975 (v;e6ks worked, definition of. 
tuli or part-time rmployrnont and incidence of unemployment) 

voarly onrninqs, and (4) data ori family income and -on 
-rtv. • ■ . ■ • 



-164- 



' Handicappe d \ 

« ^ • 

Fisher., Steven D. , et al. Post Secondary Programs for the 
, Deaf; II, External View". Research Report No, 6l ."~ 
Minneapolis, Minnesota:^ University of Minnesota, 

/ Research, Development, aod Demonstration Center 

* in Education of Handicapped Children, 1974. (ED 106 999) 

(> 

The second of. six monographs on three postsecondary 
vocational technical programs for deaf students reports 
evaluations gleaned from. deaf former students presently 
employed, their immediate supervisors, parents, and voca- 
tional rehabilitation counselors. Methods and procedures 
used m interviews and q.uestionnaires are explained. Data 
were collected' from students concerning their vital statis- 
tics, job satisfaction, economic -and employment status, 
aspirations, and views of the training and program, 
information reported from interviews with immediate super- 
visors focuses on current occupational status of tne 
employee, training, communications between supervisor 
and employee, employee productivity, 'the attitude of the 
supervisor, and the size and nature of the company. 
Replies from vocational rehabilitation counselors discuss 
referral procedures, training, and client communication. 
Also examined are 'data from parents on the occupational 
status of their son/daughter, their vocational or technical 
training, and their reactions to training. The report 
discusses interview and questionnaire responses and draws 
conclusions from the data collected. The appendices 
contain tho interview and questionnaire forms. ' 



Hull, Marc E. Voe atjonal Education for the Handicapped ; 
A' Review, Information Series #119 . Columbus, Ohio; 
The Center for Vocational Educatfon, The ERIC Clearing 
house on Career Education, 1977. 



This document is a review and synthesis of progranmiing 
and technique'^s useful for providing 'vocational education 
to the handicapped secondary and postsecondary school student. 
Specifically, the review includes sections such as; 
rationale for the participation of the handicapped in 
vocational education, barriers to participation of the 
handicapped, the impact ofAegislatiorf on the handicapped, 
identifying the handicapped, developing alternative, programs 
to serve t^e handicapped, and preyocational education for 
the handicsgtpped, evaluation of students and programs. 
There if also a section on recommendations for the future. 
Three appendices are included providing materials on (1) 
information systems on the handicapped, (2) bibliographies 
of resource materials for the handicapped, and (3) resources 
for materials for preservice and inservice personnel. 

McKihnon, -Rachel, et al . A Follow-up Study o^ graduates from 
a Voca'tionar Rehabilitation Program in a Residential 
Train ing Center for the Mentally Retarded . . Sacrame n to , 
Cain^rnTal California State Department of Rehabilita- 
tion, 4970, (ED 046 149) * 



A fp I low- up study of graduates from a vocational .re- 
habilitation program, in a residential training center for 
the montally handicapped, was reported in this study. 
Characteristics of the students, economic benefits, qthanges 
\u le-el of functioninq, need for additional services, 
student attitudes toward-^the in-hospital program, and parental 
attitudes toward the reh-h-i litation program were reviewed. 
Tht^ ui t'(.>rmat i on was obtaiiiod through interview que'stiori- 
t^airt'u P'ai I'.'tl tu students, empl'^yees and students' families. 
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Pati, Gopal C. "Countdown on Hiring^ the Handicapped." 

Personnel Journal , March 1978, Volume 57,; No. 3, 144-1': 3. 



This article discusses the lack of progress ih implementing 
the provisions of the Vocational Rehabilitation Act requiring 
federal contracts and subcontracts to take affirmative 
action to seek out qualified handicapped people and utilize 
them. It identifies eight major studies that focused 
upon bhe handicapped employee and presents four* short case 
studies relating reasons why companies employ the handi^ 
capped. In addition, the issues of reasonable accommoda- 
tion and supervisior of the handicapped are raised (in- 
cluding a taxonomy o:f motivational needs and approaches 
anvQlving handicapped people) . / • 



N.-ihhanson, Robert B. "The Disabled Employee: Separating 
Myth from Fact." The Harvard Business Revie w, 
May-June 1977, 6-8. » 



This article discusses five myths surrounding the 
employment of handicapped persons: the insurance myth, 
the dependability myth, the productivity myth, the 
accommodation myth and the double-standard myth. In 
dispelling each myth, the article presents findings from 
the DuPcnt and Bureau of Labor Statistics (BLS) 'Studies 
The DuPont study sampled 1,452 i^mployfees with disabilities, 
including orthopedic difficulties, visual impairment, heart 
dksease, paralysis, amputation, epilepsy, hearing impair- 
m<«nt and total deafness. The BLS study matched the 
performance of 11,028 severely disabled workers with that 
of 18,2S8 non-disabled workers doing the same kind of work. 
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Miscellaneous 

Lee, Arthur M. Learning a Living Across the -Nation . 

Project Baseline . Vol. V, Flagstaff, Arizona: Northern 
Arizona University, 1976. 

This document is the fifth volume in a series of annual 
reports on the status of vocational education in the United 
States. Its purpose is to report the yearly" developments 
in vocational education, by collecting information on the 
numbers and characteristics of students enrolled, programs, 
costs, and results. The entire study, knovm Project 
Baseline, was ihitiated by Congress in 1971. The report 
is divided into the following sections: Chapter I (Five 
Years of Vocational Education) and Chapter II (The Fifth 
Year) are based on statistical data, with conclusions and 
interpretations. Specifically, Chapter II provides enrollment 
data for handicapped, disadvantaged and female students. 
Chapter III (The Critical Next Step) , Chapter IV (Some 
Observations) and Chapter V (A Look Ahead) are primarily 
based on descriptive data. These data are included to add 
substance and depth to the quantitative data. Chapter 
VI (Project Baseline) presents a discussion of Project 
Baseline's past, present and future roles. 

Phelps, L. Allen, and Lutz, Ronald J. Career Exploration 
and Preparation for the Special Needs Learners . 
Boston , Massachusetts : Kllyn and Bacon, Inc. 1977. 



This text is designed to facilitate the expansion and 
I rnprovoment of secondary occupational programs serving the 
handicapped and disadvantaged student. Part One focuses 
'in the basic concepts and ideas that undergird effective 
interdisciplinary instructional planning for special needs 
students. It discusses and illustrates the nature oi 
syvcial ncHls students, career exploration and preparation 
pr<:)'.traminLnq , and cooperative teaching. Part Two identifies 
a ;>erles of specific processes designed to aid in developinq 
and imf>lement inq individualized instructional programs. 
A :-,vstematic approach to planninq, implementing and evaluatino 
instiuction is used. The apf.iendix discusses a learning 
r<Tf>rd folder, a learner profile, a learner performance 
r»'. and an i n.';t met i ona 1 module.,' 
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Schnecic, Gerald R. , Lerwick, Lowell P., and Copa, George H. 
Assessment o& the Prevalence and Service Need Re~ 

f uirements of Handicapped and ° Disadvantaged Students 
n Vocational''Technical Education Programs in Minneoata , 
Final Report. Minneajsoiis , Minnesota: University of 
Minnesota, Minnesota R&D Center for Vocational 
Education 1978. ! / 

This study is focused on a description of the present 
need for services by handi<^ped pr disadvantaged ^^rsons 
who may want. or benefit from vocatiohal-technical/education 
in Minnesota. Given time and financial constrainks , the 
study was conducted using secqndary data sources A i. e.. , 
knowledgeable persons were-^interviewed and relevafit. existing 
data werfe analyzed, ' i 

The report is divided into hree major chapters. 
Chapter I identifies the purpot of and procedures used in 
the study. Chapter II deals with definitions and indicators 
of handicapped and disadvantaged persbni while Chapter III 
identifies the prevalence of handicapped and disadvantaged 
persons in vocational-technical education. 



Urban, S^nley J. and Thomas Tsiyi. The Special Needs Student 
in Vocational Education . NeW YorW: MSS Information 
Corporation, liJ4. 



Four topical areas dealing with vodational education 
for the special needs student. is discussed by forty authors. 
Part I provides an overview of cirrent- issues and trends in 
special education. Part, II examxiies the role of lawin 
providing the special needs child with vocational education. 
Part III focuses on understanding the nature of voca^tional 
prn rams for the handicapped and disadvantaged. Part IV 
discusses career education for special needs students. The 
readings are aimed at raising issues that the vocational 
educator ^might consider. A list of special education 
instructional material!^, centers and community resources 
for the handicapped art included in §*if» Appendix. 
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Wdll, J. E. , ed. VocatlonaX E^Mcation for Special Groups , 
Sixth Yearbook . Washington, D. C.:. American Vocational 
•Association, 1976.** . ^ • . 

Twenty-four selected authors explore pressing issues, 
concepts, atid strategies concerning vocational education 
for special groups. The book is divided into three 
sections. Section I deals with vocational education and 
special groups: an overview. Section II focuses on 
specific special groups, while Section III examines strategic 
for delivering vocational education to special groups. 
The last selection' in Section I-II specifically focuses 
on evaluating programs for special groups. 



\ 




SECTION 9 



APPENDICES 



APPENDIX A 



low-up Questionnaires, Employer Follow 
Form, Parent or Guardian Follow-up 
Form and Interview Guides 



171- 



\ 



/ 

i 



Bates, Enid Buswell and Jack M. Bullock. Folloy-up 
Study of Selected Women Attending Wes't Texas State 
University from Fall, 1973, through Spring ^ 1^76 . 
Final Repbrt . Washington / D. C. : American Association \ 
of University Women. 1977 (ED 009 378) 

This study was designed to evaluate the educational 
experience for women at West Texas State University. 
Specifically, the study was designed to pr6vide: (1) 
a profile of women students; .{2) personal and professional 
information about individuals; (3) students' judgments of 
their acquisition of competencies and useful profei^sional ^ 
knowledge; (4) current information on educ^ational and employment 
patterns; and (5) feedback on how the university experience 
might be impr.oved. The method used to, obtain this in- 
formation wai a mailed questionnaire to 558 women who were 
randomly selected to participate in the study.. A copy 
of the questionnaire begins on the next pag^.. 



s 
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INFORMATION SHEET* 



Permanent Address: 
WT Address: ^ 



Classification : 
Texas Resident? 
Da<"0 called: 



Currently enrolled at WT? 



Age: 



Marital Status: 

Phone # 

Phone # 



Major: 



Currently enrolled at another university? 
Where: 



How» long since last attending school? 



Willin<j to participate: Yes No 

Questionnaire sent: (Date) 

Questionnaire returned: (Date) : 



\ 
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A Follow-up Study of Wcmien Attending 
West Texas State University 
• Frornr Fall, 1973, through * storing, 1976 
* (Former Students) * 

A, MAKITAL STATUS 

1. Please classify your marital status at the time of your enroll- 
ment at West Texas State University: 

; a. single d. separated 

b. married e. ^widowed 

c. divorced 

J. Please classify your current marital status if it has changed 
since leaving West Texas State University: 

t 

a. single d, , separated 

b. married e. widov 

c. divorced 

^. If you have children, how many? How old? 
Number .Ages 



B. KDUCATIONAT GOAL IN ATTENDING WEST/ "TEXAS STATE UNIVERSITY ^ . 

4, Wliich option best describes your educational goal in attending WTSU? ^ 



.a. .for q^^e^neral, information ^ ^ 

b. to irtprove or advance in job 

to get a new job . 

vl. for a community activity 

V. for i^rsonal or family interest 

f. for 'feocial or recreational reasonr 

to obtain degree^ 

h, ^"other {specify^ | 



[fid y(>u achieve the purpose stated above? 

a\ ^ Yes" No 

If itK), i'lo.xi\o explain, _____ 
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«<^«<K. Ail? % ^ ' 



» entered ^reetly from 

I ^* i_ entered after woFking for les^^tHan l^'yoare'*, 

• . e., ^ ^ entered af^if w@rki»g 3 yoojfs ^ melo- ; ' 

4.^ transferred from a 2-year. eeHege* ; * ' ^ ^ 

Q*' tr/kaferrpd ^f rem S«©theif 4-year -Institution • • ' 

^' ®i»e>f (Qgeelfy) ^- . *. ■ - ■ ■ • ' 4 ' 

|i. . ; J^- \ / : — — — = » 

7. Wha> per6@t)%agQ of finoneial gl^pori-did you r^ive from^our * ' 
faaily ctfi^. e^iQra while afetend^nf WtiO?" 

r • * • "f . ) * 

^* -^-nene . I__l-20>^f% " g. 80-1002 

fe... 1-10%' .- &: \ ^0-59g • 



^ 9. 



^mi many hours per week did. you work while^ attending W?SU? 

f • • » I 

Ixeludinf sumnecWssionsr how many 8emQs$ers.^w^ you enrolled 

at MSU?^ ♦ V • : ^ • , ^ . 



1-2 d. f '^"^'7-8 

b. ' ^3-4' q/ Is- 10 ^' , ■ - ' 

e. ,.__5-6 • f.. 11+ » ' .. 

.* Hl4r niajvsft summer ^apions? » ' • ' , 

, : . b.' . -3^4 ' • " ' \ . 

. v"'' " ' . '. ' 

.fO; fOhgt^^Was th^ 'average nun^r of hours you carried per sesester / 
vrtiile enrolled at Wysu? * ' ■ ♦ .„ 

b. 10-1^ . ' ^^7T 

.• • ••. ■ ^ 

' ' • ■ ■ ' . , ^/ ■ ' 

11. at kinds of courses did you meiatly enroll in at«WTSU?' v 

A* day " c. bothv ' • 

b. evening • . . • 

CURRENT, EDUCATIONAL ST/^TUS AND ASPIRATIC» - ' ^ 

12. Did you receive a degree from WT$U? \ < 
yefe b* no ^ 



13* How many predit houre have you eompleted at WTI^U?. 



t 



Havo yeu e@ntinu6d y@ut? a^uea^ion oineo loavinf V^QUt 

a. I have taken nfe e&X^eg© eoutooB oiheo ^oaving. • ,' 

^* \ X have \QkQn.smei eellbfc editfsos sinee led^rin?* 

d» I havo aehievsd a ba^eldr's ^fs^e plus gcaSu^to e@U£>8QS 

f« l.hav© aehlevQi a pr©f©884©nal degroe.^ 

•g. _. 1 have aehieve^ a deefeerafeo. . • " ' 



In the abQVQ quQs.tlon,' if you havo marked on^ CQspenso^. "b" 
threufh '"9% pleas@ list thm sehoQl or^'o^ools. 



4f= 



Do you plan t© eentinue yeur edueltieh? . < 

a. Yes, at the undergra^uat© l@'v©l at WTSU. 

b. yes, at the undorgraduato* 1|^1 but not at*WTSU. r 

c. » Yea, at the graduate le^^l at 'HT8U. 

d. ' YoaV at the graduate level but not at WTSU. * • »' 

e. '"^0 ♦ 

In th@ above question, if ybu.respon^d to "b" or«!'d*', please' 
indicate whieh oollege you will attend, when you will enroll,.* * 
and vdiat field you will pursue. . ' • 



If you have not complatsd your educational program &t WTSU, when* 
did you leave .the uni\^r@ity? 

a* during 1st semester d» end of *2nd Semester 

b. end of 1^ semester e« ^other (ipe^fy) ^ ' 

Ct . duriivg 2nd senj^ster ^ * ' " 



What affected your decision to leave^ WTSU? (State your single 
most important reason •) 

a* unavailability of financial^ aid ^ 

b* personal financial situation got worse 

^ employment prospects for cljosen fiedd were poor at that time 

d^ ^ displeased with past academic perform^ce 

e, pregnanpy # 

f* fapily^ffprob lefts ^ 

q. ^ »marria^ • . • 

h, transpor<^ation problem « 

/i* /Unavailability' o£ suitable chii,^ care 



i • fee© JBu^h edttrsQ mtk , 

I. laek ©f co6elQX life 



t 



I 



»0 



n. >■ , attituie taaily- • . • 

o. R^bilitv ©f family s' ■ ^ * 

g.' diaappelnted^wifeh ©Jip^^neei at WTStI y 

q. • other (single* ^at iu^pert'ant reaaoiriK**^ 



-- - ^^ r • - ^ 



20. I£ jp^^s^ondpd to "^p^ in th^ abov@ questldni please spooify 
f what^you 'ti^re dieappdlnted with* o ^ 



J. 



21; l£ you had intended to continue your education at WTSU but 

eircumataneea ^ose making it inr^oasi&le to do so, please specify 
* the single most imptotant reason from the list in gi^stion "19'' 
v^ich' affected your plans. 
H .. ^ - 

— ■■ — ' 

Jd' STATUS AND FUTUI® PLANS 

22.. Ara^you working in. your main area of educationar preparation? » 
a* ' Yq8 , be ^ 

23 • Which o£ the foXlmring best described your present enjoyment 

status? . ' \ « 

a. professional-technical ^ ^ ; * ' 

b. manager-administrator ' ^ ' 

c. ■ sidles woricec • . . 

d. . clerical worker x 

e . service woifter " ^ • 

f . labor-farm worker , 

g. unen^loyed ' ' k \* \ 

h. * ^ other (specify) _J 't. 



T 



24. If employed, what i^ your « reaction to your job?* 



a. I well satisfied. d. tolerate it 

b. , fairly satisfied" e. "dislike it 

c. _v undecided V 

\ . •■ • ■ ♦ «, 

': -177- 

i<l6 



If 



• 




■ undesijfafel© looatien , ^ . ^ 

salary too ,l©w 
' ^* too routine 

dw* _^ p©or working eonditiona ' * , ^ 

®* .,„^too many ro^onaibiUties r . ^ a 

f • working oiitsido aduoationai pcaparation area 

g. other (apaeify) . ^ ' > 



i 



26 1 If amployad, what influanoed you most to apoapt yo^r prasei^t jab? \ 

• a. ^sirable location . ^ ^ 

b. • salary offered ' „ 

e. ^ liked .people I interviewed with " • • , « .* 

^» spouse' 'works in ocffl»Bunity " ' ' 4» ^ 

e« > . SBOUse attending the ^iveiraitv ^ ♦ ^ t ' 

f. ^_ other, (spooify) ^ ^ 



% ' 



27, • If aa^loyed, what are . your plans as far ds your- .pre sent pos^tionA ' 
is concerned? ' , 



,a. intend to. etotinue in sao^ positim * j 

b. ^ plan to chancf© poeitiono. • 

c. am undecided at present p v ■ » 

d. plan to drop ait for time 6eing • . 

Q. other (specify) ' ' 



20. If .employed, what are your plans as far 'as your pre senJ;\ field' ^ ' f' 
= is concerned? ' » ^ ' • • - I .' v > 

a* Intend to continue in same field ' • ^ . * \ ■ 

b. plan to change fields / 

Ce am undecided at present ^ * * ' ^ 'i ' • 

d. plar. .to^drop out for tin^ b^in^^ , : ' \ ♦ 



othejr (specify) ^ 



1. 



29. If not enployed, indicate single most im^rtant reason/ t ^ 



'a* dissatisfied with jdD pyepare^i for 

b. already financially secure • 

professional > 

d. ' ^ Impersonal ^ . \ t 



did not plan to work " . ^ ^ 



f . unable ,to find employment in major field 

g. unable to find any suitable en5)loyment 

other (specify) 



7 ^ 
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19 



■ • ■ i T V • ^ . 



* 33* tmi@h tho £oll6win9 best* ieseri^s yov^ future dn^loynent status? 



^» prefessienal and te^ieal 

^* ° nanageir aa4 aimimiatratmr 

e. .^^.^ sales woirker 

d. ...^ elorieal vdikor . > ' 

®» aeevlefi voxket ' • ' 

, ^» iaber^and fana worker 



^31. If oatBleyed, hew dl4 you loeate yous first iob? 

» a/ faculty at WTSU ^ 

, WTSU plaeeneAt office * . * * 

^c. ^ new8p€^r » . ,' ' • • 

d. family, and/or friend 

0 • e^loyment' agency 

f» iheid smiie job while attepding WTSU , 

■ other fepeplfy) * 

. • i ^* • ? ° ^ : r 

EVALUATION OF WTSU EDUCATIONAL EXPERIENCi . • . ' 

32. Please rate on a scale of,-Q-5 the following services provided 
\ by the diversity that: you u^d or cama^lnto contact with. 

- 0 -» Did not use or come in contact with ' ' 

1 - SHcellent 2 - Good 3 - Average • 4 • Fair 5 - Poor- 
admissions prog^aQn > 
freshman orientatlm program 
academic atmos^ere 
overall quantity of. instruction 
faculty ihstructlon ' ^ » 
faculty availability outside of .cla^^ ' ^ . 
counseling for course selection^ 
persaial counseling . \ . 
student faculty relationships 
student relationships / 
facilities available In^ij^j/ field or study 
overall university faclij 
learning resource centen 
availability o:^ culturaf programs 
Variety of student extracurricular activities 
variety of student organizjations 
intercplleglate athletics 
overall university atmosidiere ~ 
placement service . ' 
financial aids 

health service "* ' . ' 

food service ^ ' 
university j>ollce« " IT . 

•1 
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^ 



% in yeug majer fiela has heI|>ed*Keu «^ tJi© je&. Ploas© *ate 

; . . , Q*«*v yeur major field' ©f afeufiy. \ I 

. . *■ ^ ■» ^ ■ ' 

: ^ ^ ^ ^XGGlleafe a - Oooa ,3 - Avetra^g 4 - Pai» § ^ 

. 1 ' ^« — Agrieulture Dv|pine89 and ^enemies 

^ ^' Animal Seienee 

H^t\SeioneQ . ' ' 



9 



®*, BiQleav J 

*f . * ^ EngXioh 



i 



i. 



k. History *' 



»• '■ Mathematieo 



n« Milltaary SeieneQ 

, ' B^odern Langua?® 



( 



^i^•'^Z^ Physios . • . . '- • 

«t. . . PolitieaX Seienee * - ' . 

' r. ' Sooiolbgy . ' * — % 

s. Social Work 

f t. ;_''Accounting » 

• u. Business Adroinisteation * ' 

V. Business Education » 

' w. ♦ Of f ieei Administration » 

^ Coraputea Infonnatien Systems 

Elementary Education 

o_ Health, Physical Education,, and focreatipn \ 

b^. ^ Industrial Education . • • . • 

cc. . Psychology / • * 

dd. ' ■ School Senfic©? • 

ee . . J Art / • ■ -o ■ 

ff. Music . * 

99 . Speech and Iheabris " . ^ 

hh. Nursing ' '..*•* 

ii. 'Counseling ^ * 

Secondary and Higher Education y • . 

34. To what extent has your college training helpea you in ©Staining 
your present job? . 

» • 

12. ^ great deal q. little 



b, scane - d; 



none 
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if* 



* 



r 




for youz 



3S# tihat extent lias'yeur eollego training prepared^ 
jGb ^iUs? 

a* ' ' a groat ^L^.' ©. . Uttlfe. 

3g, Woul^" you^oottraend ife^O to a person seeking to oou^lete the sa^ 
program tiiat you majored in 




JM, a. ^ 'yes. » 

why? 



b. . 



no 



4> 



37.* Please cheok the degree of satisfaction to^whieh 
' prepared you for additional aeadenie work. 



you feel WTSU 



a. 



extremely satisfacl^oriiy 

satisfactorily 

uns'atisfactorily 



1 



38.. Were you interested? in learning the course materials? 
, a. **, yes b. no 



39t Please rate on, a scale of 1-5 the following classroom conditions. 

. . .1 ExGplleht '2 - Good* 3 - .Avek'age 4 - Fair , S - Poor , 

a. adecruati lighting d.' 

_____ adjequate ventilation 

c., ■ sufficient blackboard 

space ' . . . • 



» 



appropriate furniture 
conducive acccustics 




A. 



40. • Did you find chil/* cd.re a pr<*lem while attending school at WTSO? 
yes ^ • hk no. 

* * « 

41. , Di^ you find housing a ^problem %#hile atten.ding school at WTSU? 
yes b.., ^ no 

4?. On a scale of 1-4, rate the degree of concern shown for women 
students at.HTSO by the listed groups of people. ^ 
I - high 2 - moderate 3 - little '4 - none 



a. 

b. 
c, 
d.' 



administration 

faculty in major field of study 
other faculty 

other students , ' * 



ERIC 
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43. On a seale 3£ 1*§, please ca^ all of the £ield^ of study bo low ^ 
in vAti'eh you have tfJcen one or more eoiirses. ' 

1 - exoeUent 2 - Good 3 ^t^-A^rage 4 - Faiir S -.Poor 



a. 

e, 
d. 
o. 

> 

i. 

1. 
m. 

of 



9. 
t. 
U. 
V. 

w, 

X. 

y. 

-2. 

aa. 
"bb. 
cc. 
dd. 
. @e. 
ff. 

gg. 

hh. 
ii. 
jj. 



I 



Agriculture Business and Ecm^es 
Aninal Seienee ' 
l^lant Seienipe ^ 
Bible' ' ^ 

Biology » 
Chemistry « , 

English/ 
Geography 
Geology 
Anthrc^Qlogy 
History . 

Joiiynalism . ^ .. . 

^thematies - , 
Military Soience . ^ 
Modem Language <- .;. 

"Physics ■« 

^Political Scienci@ ^ " f 
^Sociology ' • ' 

Social Vork , 

Accounting , ' . 

Busit^ss A(^in^stration - 

Business ^^catim . 

Office 'A^ninistration ~ 

Con^uter Information Systems 

Business Economics 

Elementary Education . 

Health, Physica^^ Education, and Recreation 
Industrial Education 
Psychology , ^ 

vSchool Services 



Art 

Music • - ^ 
Speech and Theatre 
Nursing 
Counseling 

Secondary and HigKer Education 
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3. Fi^FBSSXQNAL HQIORS AND/OR BSCO^ZTZCSIS RBC&ZVBD 

44. Please list any professional hofiors and/or zeco^ltlotis you 
^ ^ ' reoslved while attending WSSU, 



H. SUOSSSTZONS AND OBSERVATIONS f6r IMPROVING THE p'ROQRAMS AT WTSU 

'45. Mn what way eould your experience at WTSU have been nore Mlpful? 




5 



6 ' 



« . 



IfeTl ^t^^' ^'^^ ^y^^ll and Jack J«. Bullock. A Pellow>^up S tudy 
pf Selected Woaien Att^ din ^ west Teic^a Si^i^te Univer sity ^ rnm ^1^11^?, 

-Tr?' '^f'"^' 1976 Amal Report (Washington, D.C^t^Ail^cS'L^ocilu on 
University Women, 1977). c*«w.on 
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Burkheiaier, Graham J.,, et Evaluation off the ^agia Bound 
Pgoerramg A Fir et Follow^upV >inal kepori / ' btu^ 
Nortij qaroii«ai Research Triangle in,stitut©, Center 
. for Educational Research and Evaluation, 1977.x 

(BO 148 891) ' . • . V • 



1 



' . This study is an attempt to obtain 'information about 
educational outcomes for the Upward Bound Program partici- 
pants, """^j^pward Bound Program was designed to reach . 
low income high eohbol students *who have poteritial fd^ 
successfully completing an educational^programi but who, 
duetto inadequate preparation and/or lack of motivation » 
are prevented fr^ meeting conventional criteria for" 
adfflissitti to a post^secondafy program. Th^oui^h the u^e of 
various intervention tedmiques . . . the'prograii^ is 
legislatively mandated to generate in participants the 
skills and motivation necessary %o enter and successfully 
complete postsecondary education." j 

From the. 333 regular Upward Bound programs operating, ' 
54 were selected to participate in this study. A total of 
3,710 students from the 54 programs were sampled. Each 
respondent was asked to complete an ei^t* item mail ques- 
tionnaire which was designed to tap. their educational and 
employment achievement. The Questionnaire appears^n the 
next page. • * • *. 

• » 
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. Pollow-up gu©sti«wiait© for Natioiwid© Study of Young A^lts*, 



My nsm and addrosa .axe ^ 
Both OK as printed * • ^ 
, Co* ©et ay nam to ' 



.r©et my addr@8s to 



First , Middle ' Ust ^ 



Street,. Route » and/or Box AddrQoa 



I. I • . ... fr 

City .State • Zip Code 



Th« telephone' nuiBbfer at whidj 1 can reached ia . ^ ^ 



Area <Code . Number 



'1. What is the highest educational level ypu have ooa^^leted? 
(Circle only one) 

Trade or 

High School /Vocaticai&l school • College University 

1— rlOth gtade 4-^Le's8 than 1 year . 7— 1st year ' 

2— 11th grade • 5— -One year ' 8<^-2nd*year 

3— 12th grade 6— Two or more years ' 9— 3rd year . *, • 

, • _ ' ^10— 4th year 

2. Are you currently working? (Circaa only one) ^ ' * 

. 1" No • . ' *. 

2~Yes, full-time ' 

3— Yes, part-time ' , • ' 



3. Are you currently eervl^g in the* military? (Circle pnly orie) 



. 1 — I We never been in the service*' . 

2 — ^I'm in the service now. 

3- ^1 »m now a veteran « ' . 



4. Are you currently enrolled in .any school? . (Circle pnly one) '. 4 



l~Not enrplled. 

2 — ^Enrolled part-time 

3- ^Enrolled full-time 



I 




S'. Fleas© fiv© the 'exaet nasig and Ideatlbn of tha school y^u are 
afctei^tng ot last attended. (Please do* not abb'reviatv^) ' * 



School Name 



* - e 



' 6. » 



6'. What is the gjfa|itest amount of schooling you expect to complete ? 
(Circle only on©) • ^ . 

1— High school only , ' 

2- rVoeational, trade, or business school " , 
. 3f— $eme collage • 

4— Finish 4 year college (BA, 8S) \ 

5— Qradu^t© or professional degree (MAi Ph*D.j MD) 



' ■ — ^ 



(i 

7'. What problems have you had in ge^tting the kind of education 
r ^ you would, like" to get? (Circle all that ipply) 

1— Poor grades " . • « . 

2— Poor high school preparation • ' ^ 

3— ijack qf personal or family finances ' * ' 

4— Inadequate finanpial aid ^ ^ . • ' 

5 — Program I wanted is not available - 

6— Family responsibilities. 

= — ■ ■ — ' ' r ' 



8. • Did" you aver participate in an, Upward Bburid Kogram? (circle 



all that appAy) 



a-'-Never ' a—Yes in grade 11 

2-rYes in gradqi 10 . , 4 — Yes in grade 12 

■■ % : 



THANK you FO^' Y06r COOPERATION 

... ^ ^ . ^ ^ 

• . ^ 0MB' No. 51-S76047 

OE Form 524 Approval Expires June 30, 1977 



♦Source: Graham J. Burkheimer, et. al. Evaluation of the Upward Bound; 
A First Followup, Fi'^al Report (Durham, NOrth Carolina? Research Tri- 
angle* Institute, Center for Educational Research and Evaluation, 1977). * 
•(ED 14& 891) 
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Fisher, Steven D. , et axN- Pbsta^condary ^rqgrams fbr the - 
Deaf t -411.. iBxtem-al View, iites^arch W ert? tio. 61. • 
^ 'Minneapolis, Minnesota j tA)lversi^y oi Minnesota, * 
Research, Development, and ftemonstratibn fcehter in 
^Education of Handicapped Children, 1974. I (ED lOQ 999) 

* , ; . •• °' . ^ ' ' ■ ' 

♦ ■' ■ ' ' 

This '^kidy focused on the follow-up of deaf students 
^ from postsecondafy vocational technical programs". The 
information was obtained ^from foirmer deaf students employed 
at the ti^'of the study, their immediate supervisors, 
parents and vocational rehabilitation counselors. Personal 
interviews' and mail survey 'questionnaires were used to 
collect the data. ' Dati were collected from students 
cdnbeming their vital statistii^, / job satisfaction," 
economic ^and employment status, aspirations, and views of 
the training and program. The inj:erviewjs with immediate 
supervisors fpcused on the "durrent loccupational status of 
the employee, training, communications between supervisor 
and employee, employee productivity, the attitude of the 
supervisor, and the size and nature of/the company. . 
Rehabi ligation, counselbrs were queried^ about,* referral 
procedures, training, and elienlj ' communications . Data 
from parents vjpfre also examined concentrating on the 
occupational status o% their son/diughter,^ their vocational 
or technical training, an^ their reactions to training. 
The following pages contain copies of the "^instruments . used 
to collect information from each of. these four sources. 



ft 



INl^RV^W WITH YOUNG DEAF ADULT* 



Vital In format ie« 



Date 



b; Blrthdats 



e. Male qr FdaialG 
d, Mdresa 



Phone 



e. Parents 



(1) Nans 



(2) Address 



Phone 



f * Marita^ Status 

(1) Married 

(2) Single 



(a) number. Qif children 

it 

(a) engaged 

(b) go steady 

(ci neither . 



(3) Divorced 



g. Is your 'wife (husband) deaf? 

■< 

Hearing? 

he Ar© you: 



working (employed) 
housewife 

student ^ 

none 



Hard of hearing^ 



If *'none/' explain^ i.e.^ unemployed^ etc. 
i» What school are you attending now? 
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Oceupatlonal St^a (Do not II, m, or IV if caitinuous student) 
a; Jobs (begin with, present jda and work bac^ to 'first jdj) , 

1. CoB5)any . Addreies ^ % 



Description of work 



■ — r 
Dates of employment: 



4i 



* • 



Still working there . ♦ % , 



Reason for departure ' 
Date of departure ' ' . ■'' 



2. Can?)any • Address 



Description of work 



1 < ' 



Date o^ departure. 



Company ^ Address 



Description of work 
« 



I ^4 



p^ites ot e'raployinent 

; r-^t — 

still working there ^ ' 

Reason for departure . 



Date of departure«^ 

1 r-r 



e 



Dates of employment ' _J ^ 

Still working there * , " ' 

Reason for departure 
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Description ©f %rajrk . 



DatQs of eioploywnt ^ 
St^Xl working theSre _ 
Reason for (toparttire 
Dat8 of departure 



Job Satisfaction and COTcrunication (Ask III if presejitly es^loyed 
full or part tine) 

a* How did you find your j6b7 ' (Vocational- re^habtlitationf want ad^ 
'eoypXoynant service > friend, psxenta, schqolv-^tc.) 

' ' ' , 5j : / 

b. -Do you like your job?- 



tikcp it "Very' much ' 

. Okay ■* •" 



Dislike most things abotj^ it 

^ f 

ft your job? ^ / 



9 



c» '-^W^y do you feel this way abou't your job? 



1 ^ 



d. Do you Want to keep your or would ^^ou want to change? 

Keep my job - * ' Change jobs J_ • ' ' / * \ 

e* If the /ansi^r is **Change «T6bs** why do you ^ant tb change? 

. / • ^ • • — — r ■ — )- — '-H^ 



^> / 



f. How do you .communicate with your Idoss (ibanediata supervisor)? 



Sf3eech ^ Formal signs ^ 

Writing ^ ^ * Natural gestures ;^ ^ ^ ^ 
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9. Dees your boss unddrst^and you? „ ^ 

Always ' . SomBtliRQs 

Most of tho tine Never - 

*h. - How does your boss coxnrounlcato with you? 

)■ . •• , • j ■ 

Speech / . * Por»al pigns 

. Writing ' ^ ' Natural gestures 

i. Do you understand' yo\xp boss? 

Always ' : l^ome times 

Most of the time ' » Never 

j. tftiat is the^asiest means of oomounication? 

Speech ^ . Natural gestures 

' . writing s^. other (specify) 

Formal signs 

. . y 

k. Do you<-thihk your boks would give' you. a better job -Lf one were 
available? A ' . ^ ^ 



Yes . . No » Not Sure 



1. If "no,"- vhyf j_ J_ 



Economic Status (Ask Part T^f^ly if presently employed full 1 or 
part time) 



Do yqu work full time? 



9 



Average number of hours 
Do you work part time? _ 
Average nxunber of hours' 



b^ Not including overtime, what is your gross and net pay .(indicate 
both) ? ' , ' •' 

■ ■i . 

p; Do you ever. work overtime? Yes No 



d. If yes, how much .money, on the average, do you make each week 
on overtime? . • * 



?1 



ft 



e. Do you roeelve financial help from anyone? (exploding husband 
• or wife)? , . • 

f. If "yea" from whom? Give Average wt^ekXy amount. (co.un.t room 
^ and board at $15 per week) • 



Source 



Aspirations . 



Average weekly amount 

1 



\ 

. \ 



a. What occupation would, you -ll^e to have ixy ten years? (Person 
may choose homemaker) 



c. 



Wbiild Jhis job require more training? 
Ves No Kind of' training 



d. \ ll th© answer to b is "no" or "not sure," ^y won't you have 
,%hat job? .. 



Do you think that,yoU will have that occupation in ten years? * 
J^es !^ ^. No • Not sure 



r 



e," Would you prefer' to go t6 school with: 



Hearing students 
Deaf students 



• ^f. Why? 



Both 

Makes no difference 

^_ ^ 



\ 

A 
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V>Z . .Studonts (To bG asked In addition to Sections Z and V) 
a. When you^l^ave t^is •sct^ool, t^at do you plan to do? 



(1) Go to college ; 

(2) Go; 'to work ^ V/' 

a. What kind of work will you look for? 



V 

CI 



(3) oth^r (ex|)lain) ' \ '\ ' 

(4) uriaecided . ^ """^ \ ^ \^ — ^ % 



Have you ever had aqy suimner or part tlsie jbb? 
c. If "yes", ^scribe J . 



4- 



VII. Sa^sf action with Training (both present ath'd past ^studen^ts) 

^. a. Aye you satisfied With* the training you received . (are receiving • 
at this school? • • . • 

b. If the answer to no, «hy are you not satisfied" with \ 

the training? • , ^ 















> 

\ — 









(1) Locaticsi 



(2) Duratiai in minuteis " * . * / 



(3) Interviewer 



t 



♦Source: Steven D. Fisher, et«al. Poatsecondary Programs for the Deaf t 
II. External View. Research Report No. 61. 
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INTERVIEW WITH ^imgPIATE SUPERVISOR 



* 



General Iitforaation ' Date 
a. Mane of deaf en^loyee 



b. Conqpany * ■ Address 

c . Supervisor ^ing In^rvlewed ■ 



d. Maa>a ' '\_ Position 

. T ' : ■ 

Curpnt Occupationa£ Status of Employee 



4 

a. ^Descrlfad In ddtail the Wotk.perfbmad by the employees 

■ • : ■ 



b. ^D^acx^tie all 'previods jdbs, if any, held«by the ^nploye^ in 
"this conqpany? 

■ ' '■■ 

. . . . . _ 

: — :: 



4 



c. .If the employes has held. different jobs, does his present job 
constitute:. • *' ' ,, j „^ 

a promotion ^ a demotion neither 

d. iSt the eioployee has held different jcbSf Is his/her salary nowt 
higher lower ^ the.sazne ■ >' 

Training * . 

a. ' In order "to acquire proficiency in the employee's present job^ 
}Ax^t is required? (check one) ' ^ / 

1* sii!5)le demonstration 

2. on the job training 



3* classes conducted Jay , company 

V 4* 'possession of trained skills' (prior to hiring) 

» 

b. Describe any training required prior tOtMring for present job*. 
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If ea^leye© roeeived taraining at a technlcal/vocatiaial school * 
, before being hired, do you think ttiie training wafe adequate?' 

• ■ ■ ' ■ #■ ft ■ 

. . Does not apply ■ 

< . 

If answer to ••c" ia no, explain* 



Do you feel that aidditional training would benefit the eaployee? 



yes No iiot euro 



Why? 



What opportunities foir advancement do you think he/she h^ in 
your company without further tralping? 

Considerable .Limited None 

Why? ; - 



What opportunities exist with further training? 

Considerable ^ Limited - None 

Why? - • '. * • 



List any ji^r in your conpany \i^icH you feel that the employee 
could handle with more training. 



If you are in favor of further training for the einployee, what * 
type of training would you suggest? V - 
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IV. eofflmunioatloft, «i ' 

a. ' Do you caammicate^ with this emi^loy^? Yes j j No 

b. How 40 you commuRieatd with this en^Xoyee? • 
. ■ . ■ \ . 

. Speech and speech i^adin? 
Sign language • 

Writing v 

Gestures % 
Pingersp^lling « ^ 
6ther (specify) , 



e. Have, you leaxlied sign language? . Yes No 

d. Does the eaqployee understand your instructions? 

Always Occlfeicnally 

Us'ually ^ ^ Never * 

How well do you understand his/her speech? 

^ All of it ' ^ Some of it 

Most of it None of it ..^ * 

V. Productivity , - * • 

. a. How would you rate this eoqployee £n comparison wi€h others 
doing the same job? 

Above average ^ Average ^ Below average 

b. Can you list any aspects of the employee's job which are 
c^i^licated by his deafness? 



O V 

• I* 



c. Name some personal Qualities, if any, of the, enployee which, 
you feel contribute to his value as a worker. 



d. Name some personal qualities, if any, of the employee which 
detract from his value as a worker. , I ' * 
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AttitMde of ItomedAate Superviae r' ♦ . ' 

a. If the dQoislm were yours,' would you favor having nqf^Q deaf 
people working under you? • " ' 



.■4 



Yee C '\' No ' Not Sure 

• ■"' wf ■ ■ • . ••• 

b. If -m" or "not sure, "- why? . ' " 



' — = — ^— : 

c. Would yoii' prefer not to' have deaf employees wdrking wider you? 

Yesa ' No • Not Sure * 

d* Any additional coontents you oare to nS^e? ^* . ' 



'^11. Siae and Nature if iceaBPany » ' ' 

^. What is the nature of the work your coaapanv engage© in? 



D, How mfmy people in all are enqploypd ^y your coorpany? 



(1) Location 



(2) Duration in minutes 



(3) Interviewer 



♦Source: Steven D. Fisher, et.al, i>ost8eoondary Programs for the Deaf; 
II. External 'View. Researrfi Repof t^ No. 61 , 



' VOCATIONAL BEHAGlZLII^ION COUMSSI^ QU$§TIONMAZB& * . • 

Ihe Minnesota Kesearch, PeVQlojpmant and Oeiacm^ratlon Center In 
Education pf H^dicapipe^ Children is currently - gathering data frcia 
three' deouMifitratlon postsecmdiary j;>roJect8 for the heaTlng-i&ipalred 

in an a^ttev^t to fonoulate guidelines for 'the establishment of 
additional programs '(Title i Improved Vocational* Teohnioal, and 
Academic Opportunities for Deaf People t Beaei^eh Component). Uiese 
proje<3ts aire funded through the coi^eration of the Vocational 
Rehabilitatim Association and the Bureau of tHe Education of the 
Handicapped. 'Your answers <m this questionnaire will be a 'Valuable 
supplement to^'our data gathering effort. 'Please answer the questiorfb 
to the best of your abilit/ and feel., free to write down additional 
inf.ormation if yo|i desire to do so. ' 

♦ 

General Information (to be completed by R06D Center personnel) 

A. ' Name of vocational rehabilitation counselor • 

Address . ♦ 

B. Name of hearing impaired client • - • 

Address > • ' • 



C« Postsecondary program attended 



Procedure ^or Referr^il 

■ . . ' ••- — - ■ ■ . ' . ' 

At . Where dp you obtain Information for referral of the heariit^ 
Inqpaired client for training? 

i 

— ' ^ — ^ 

B. Are you contacted by the programs for the hearing; impaired? 



If the answer to "B" is yes, briefly outline >the procedure followed. 



/• 



C. Do you contact 'tHe program for*th6 hearing iapalre'd? ' • ' / ' ^ 
If the ^swer to. ''cr i^ y©s, briefly outline the.^prooedHre foUowed. 



D^, HJhat do you consider €hie most positive asj^cts of the reftgcral 
procedure presenWy employed? * . 



/ 



' . ' ^ . — \ — ■ • r' r ^ 

E. 'What do" y^u .consider the. mpst negative aspects tije^ referral 
. prQced'ure presently einployed? * 

1 Y., ■■ ■ , 

. / ■ • ■ V • 
-. , - • ^ • ^ •- • 1^ . 

\ 

— : : ; ^ : 

■ ^ ■ i - ' • a '■ 

F. What changes would you maHe in the present referral "^ocedures^. 

7— ' — ^-H^ ^— ^r^ 

. ■ ♦ . • i . > 

^ 1^ • • • - :^ ■ 

.t * ■ ' ♦ * • • 

Tra'ining Rieceived by Client • ^ 

A, ' Do you feel tha^ the training received hy yotir client in his/her 
postsecondary program was adequate?. ••_ < 



, If the answer to "A'' is no, why? 

» ' ' n — 

) ' ^' ' ^ ' 



I 



If answer to "A" is yes# what do you consider to be the ^ 
best feature's of the training program? ; * " 



,.B. Did play a major part in recosmbn^ation for a speeifio typ^ 
of training., for y'dur tcli^nt in tha po^^secdndary pre^ram?^ 



P If th@ ^answer t'O *'B" is y@s, ^Sscribe your x,o\%l^ 



4^ 



If' the answer. to '•B** is no, 'do you feel you should play £i greater role? 



Wha^t do you feel «y.op can oontribiate? 



C, Do you feel that your client's sphooling pprior to postsecondazy 
»^ training was adequate? ^ " - 



If the answer to "C" is no, why?_ 



If the answer, to "p" is yps', What do you consider to be the best 
featifires of this schooling? ^ ' 



Coiranunication with Client o . ' ^ 



A* How did you coiranunicate with your client? 
• " • * •» 

Speech apd speech redding V 

Sign language * 

FUngerspeiling 

Writing ^ 

Gestures ? * , , 



Interpreter; aid ^ 

* Other (specify) 
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B. H©w Bludfi of his caaaun ication— no matter what form it tobk— 
dia you und^r,8tand? ■ c * • . . . 

All of It ^ Some qf 4t . , - ' ^ 

Most of it Kone of it 

If you did'not njrtdetstand yout client's communication, what means 
did you' employ to fully undersl^d 



Ci' How much of th^ speech did you understand? 

All of it • Some 6r it 

Most * of it ^ . None of /£t ' . " 

D. What manner of communication is employed by the parents (guardians) 
of the client with their child? \ . , . , . 

Speech and speech reading .'• • 

Sign language ' 

Pingerspelling ' < 

Writing v ■ . ' 
(Matures 

Other (specify) . " 

Not applicable ' ' t [ 

Not available j 

As nearly as you can determine, is this communication effective? . 
Yes ^ No"* ■ . . 



If the answer is no, \^y? 



Additional Informatioi^ 



*Sourc«: Steven D. Fisher, • et al. Postsecondary Prograitts for the 
Deaf? External View. Research Report No. 61 . 
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QUESTIONNAIlffi FOR MOTHER 

Plejs© follow these guidelines in answering this 'questionnaire. 

Answer all the questions that apply to your son or daughter. You 
will be unable to answer soate *if your son or daughter is still in 
school. , 

G^eral Information 

.ca. Deaf* son or daughter's full^nan© 

Address , Age 

•Male " Female * . . ' ^ , 

b. Parents' name 

^ > flddr^ss 



•e. Your occupation 
Address 



d.. Are you deaf? Hard of hearing? Hearing? 

Occupational Status of Son or Daughter 
a. Is your son or daughters ' 
working full time ^ • ^ 

working part tiitie ^ • i» ^ 

going to school 
lookihg for work 

a haymaker not employed outside 

other (please explain) \ 



b. If your child i's^rking, please describe his/her job* 

•— kI I . 



c. Do you feel that this is a sood job for your son or daughteri* 
' Yes No ■ • 

. Wiy? ^ 



m. .What do you believ© would-be a good job, given tho •noceseary 
training, for yc nr son or daughter? • 



- . ^ ■ I ^ • ••^ 



f. "Why? 



Vocational/Tfechnical Ti^aii^ nc f * / * 

4 <• - . if* , 

a. Prior to attending a technical^^ocational program, was his/her 
education at the ^^cpndary level 4n: (che'pk- more than , one if . 
appropriate) • ' , * 

(1) a residential school for the dei ^ ' • ' ^ ^ 

(2) a day program for the deaf ,^ X ^ 

' (3) an integrated high school- 

b. Please answer the following questions conceming ^e training 
your child received in a technical/vocatioh&l program'' for the 

' deafe , ( 



(1) naxite of school 
(Z) address 



(3) general course taken 

(4) length of course 

(5) dates attended 




(6) Did he or she graduate? Yes No 



I' 



(7) What was the total cost to you personally? ' 

(books, tuition, board, transportation, etc.) 

(8) Did he or she receive any outside financial assistance? 
Yes Soujrce 



No Amount 



(9) Did your child encounter difficulties of any .kind during her/his 
course? Yes No 



If yes, describe. 
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Reaction^ tcVocatlonal/TQighnlcal Tralnijug 

a. Do you favor having postseoon&ary programs fd^the" hearing , 
Impaired within agoing' prpgrams for stutitents with normal hearing? 

Yea . NO ^ . Not Sure ' " 

Why5 'f " . . * / ' " 



b. Hew do you fetal ahiout your°child's vocational/technical training? 

(1) satip^^fied . • . ^ . • 

(.2) Dissatisfied 

. ;3) Mixed Reactions . • . ^ 



Why? 



c. Whaty if any>„do^ you see to be the good points of your child's 
.vocational/technical training? , 



d. Whajt, if lany, do you see to be the bad points? 



— ^ 



e» How much contact did you hdV«'Wlth the program your chird attended? 
Was it adequate? " Inadequate? 



Explain 
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A 



2^3 ■■ 



.\ Othet Qiildren 4 indicate whethek hearing, deaf, or hai^of hearing) 



^ 1* Naafea 



Age Sex Highest Grade Coaapleted . 
. ^ (note i€ still in school) 



2. Fill in for any hearing son or daughter presently employed. 



Nanie 



Job Descripti^ 



Weekly Wages 



% 


^. : 




1, _ 


\ 






• * 


Nane ° 






Weekly Wages 


Job Description 




r- 


^ \ ^ 




$ 






., . • . 


Name 


* 


• 


ti ■ 

\ 

Weekly Wacfes 


Job Description 


"1 


1 








\ 

f 


=^ 










T—^ i— 




4 • 





Signature of person filling in questionnaire 



4 



(If relaticaiship is not mother, please in4icate) o 

■— \ " . ', ■ ■ • 

♦Source: Steven t>. Fisher, et.ai- Pos^secondary Programs for the Deaf: 
11. External View. Research Report No> 61.* . ^ . ^ 
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• QBSSTIONMAIHE FOR FATHER * ' 

* ; " . — : , »^ > 

Please follow these guidelines in answering this gues1:ionn|iire 



• 



Answer all the Rations that apply to your son or daughter. You . 
will be unable to answer sooe if your son or daughter .^s stiil 
in school. • ' . ' 



General Jnfonaation ' 

4 

a. Deaf son or daughter's full name - - 

Address ^ Age 

Male ■ ^ Peroaie ' • . 

b. Parents' name " ^ 

Address . '2 



c« Your occupation 
Address 



Occupational Status of Scm 6r Daughter 
a« Is your son or daughters 



c 



working full-time 

working part time f 

going to school 

looking for W9rk ^ 

a hdnemaker not employed outside 
other (please 9)5) lain) 



b* If your child is working, please describe his/her jobi 



c. Do ydu feel^^that thi's is a good for your son or daughter? 

. Yes ^ jUo , . . € 



d. Why? 
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e. What do you beUeve would be a. good job, given the necessavy \ 
trailing", for your 'eon or daughter? l ■ 



.Why? 



« 



Vocational/Technical Training 

a. Prior to attending a techniaal/vocational lirogram, was his/her 
educatim at the secondary level int (check- more than one if 
appropriate) , . 

(1) a residential school for the deaf j ' » 

(2) a day progrAm for the defaf ^ 

(3) an 'integrated high school « * 

b. Please answer the following questions coneeming the training 

your chi^d ^received in a technical/vocationa^progran for the deaf.. 



•^1) name of school "'-.^ 
(2) stress , ^ 



(3) general coxurse taken 

t 

(4) length Of course . ^ ■ ' 

(5) dates attendeii » " 



P 



(6) Did he\or she graduate?!* Yes No 

(7) What was the total cost to you personally? ^ 

(books, tuition, board, transportation, etc.) 

* « 

(8) Did he or she receive any cnitslde fi^ianclal asslstanoe? 
Yes ^...^ Source / - ^ . . > 



No Amount ^ 



(9) Did XQur child Encounter difficulties of cany kind dufing 

his course? Yea. No 
I 

% 

If yes, describe 



\ 

. \ ' V 



IV. ReactiCTis to.Vocatl<mal/T6dinical Training 

Si, Do you favor having postseoondc^ programs for the hearing 
^ ifi^aired within ongoing programs for students with normal hearing? 
. Vee No . Not Sure , 



Why? 



b. How do you feel about your Guild's vocaticaiial/technical training? 

(1) Satisfied • « 

(2) Dissatisfied ^ 

(3) Mixed Reactions ^ ' , 

Why? 



c. What, if any, do you see to be the good points of your child's 
vocational/technical training? 



• 


What, vlf any, do you s« 


i@ tb be the bad points? 


• 

1 



e « ^ow' piuch contact did you have with the program your child attended? 
Was i^ adequate^ - Inadequate? ^^^^^^ 

Explain: • " [ I 

^ , i ! . 



4 
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other Children (Indicate v^bther hewing, deaf, or hard of hearing) 

' . ■ ■ ' ' * "» ' . 

1. NtfBg, • Agg^ Sex Highest Grade Com&leted 

\ (note if ftill in school) 



2. Fill in for any hearing soir^or daughter, presently eaqployed. 

•» * * ■. * 

None • ' ♦ weekly wage 



Job Description 







Weekly waae 


1 = 

\ ' * • 








Job Description 




• 


* 




* • ■ \ 


t 


Name 


t 

weekly wage 




<► 

Description 






« 

\ ■ o 

... o 





signature of perscm filling in questionnaire 



(If relati'cmship is not father*, please Indicate) 



♦Source: Steven D. Fisher, et..al. Postsecondary Programs for the Deaf; 
II. External View. Research Report No. 61 . 



Qu^ty, 'Michael. ^ 1975 Career Stttden't. jtollow-up i Ij&i?t 
„ Placement * Overland Park# Kan^st/ Johjis^ Co^ty 
Comnunlty College 1976 (ED 199^9) 



I'tial. 



This study sampled 177 students in the career education 
program ^(both graduates and ^ghi^gradiiajbes} ^ho .left with^ 
marketable skills. Seven (7) bf the students in th^ ^' 
sample were hearing in^aired. 'While the data generally 
.were collected over the 'telephone , heariij|L impaired studei^its 
were contacted in person. The interview wa)^ designed to 
capture inform'ation in two ar^as. /First, resppndents were • 
. queried as to their, employment status (e.g., currentljbb, 

salary) and tl^ utility qt the prdgram.^ Second, qtiestions 
. were ai^d at each type blf>trainijrig course provided at the 
community collegfe (e.g. / nursing! data pro^ssing) 



its effedtiveness. 



to determine 
The forms usejd to collect the data 



begin on the next page, 




\ 
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Student's Name J ' * 



Address 






c 


9 


f 


CALL RECORD 


» 




• 


Time 


' \' . . 

&ate # called 


Fesp<mdent 


—h^ 

Call 


















c 


o 


* 










■/ 




> • 

Pei^cih giving final interview » 


NdCest 










• 


* 


BEGZM XNTEBVIEW 








Is this the 


residence of (Student's Name)? 


( » 




i 



May 1 apeak (Student's Name)? (If not available, record day, tine 
and phone number, for call, back). 

ihis is (your name) of ^^^pn Comity Community College, The College 
is conducting a follow-up study of students *«io have been enrolled* 
in our career programs', is to obtain informati^^equitedo by 

the state .and to. more accurately assess the effectiveness of our 
career programs. May J aSJc 'you^a few questions? 

Let me begin by checking^ see .^f our information is ,correct. 
Your name is ^ (See Above) 



Your Social Security number is 
Your address is 



Your h&ne phone number is 
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I 

V 

I 



i. 



ERIC 




' 1. What Is your afia? *sex» Male 'Female 

Marital Statusi Married • 

. Single . .. 

2. Are you currently in the Amed Forces? ' ' ^ 

I * * 

Yes (reservesL? ) 

MO • . LJ 

*3. Are you currently einployed? , . 
Yes Full time? Part time? • * . ' ' 



ft * 



What is your job title? 
Wio is your employer? 



A*i»8s - . < City ^ State - / "Phone # 

Would you. say that your' current job is » ^ 

1. occupation for irtiidj you trained. . ' «* 

2. An occupatioil related to your training t ^- , * % 

• »• 

a. ^id Vour' JCCC course work help you obtain the j.ob? 
• Yes " . ^ No ' , / ../ 

b. Do you feel the JCCC program can adequately,, 
prepare a person for this type of job? 
„^ Yes . No ^ , . ■ 

c. Overall r would you rate the ^CCC program as being: 
I Excellent Adequate 

Good Poor 

d. What is your gross annual salary (befoz^ ■ over- 
time and taxes) $> , Montlily $^ 

' . 3, An occupation not related to your training: 

( a. What is your gross annual salary (befpre oyer-^ 
, time and t'axes)? $^ Monthly $_ 



b. Do you .intend to, ultimately 'work in a job related 
to your program ^ea?' * . ' \ 

. Yes No 

» C Overallf/jjiould* you rate the JCCC program as being: 

J Excellent ^ . ^ Adequate 

Ctood . • Poor 

_ No Are you seeking employment? Yes » ' No 

Overall, would you rate the JCCC program as being: 

Excellent Adequate - ' 

Good Poor * • " 
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4,. Are you qurrentiy' attending/ a^hool? 

• * r - . .. * 

'tee Pull-tixi»7._ i_ Part-tiJii? 



» 



a. What school aze you attending? ' ' 

'*b. Are you in school- in vocational' or technical teaching 
^training? Yes ; " No ' • 

c. Are you in schoo^; in a field related to your trainihg at 
.' JCCq? Yes No . . r 

d. wH^t \8 the highest gradte level you have^ ccnplete^? a. _ 



^ Np . (If unettployed determine if* disabled or-decewed 

5." Do you. have any questions oz^ comments that you would like to mak^ 
concerning the JCCC7 ' ^ .* ' . * ^ 




♦Source: Michael Quanty. 1975 Career Student Follow-up/ Initial 
Placement (Overland Park, Kansas: Johnsoi^ County. Coonunity Co&lege, 

, 1976)! (ED ,126 999) ^ 
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, ADDITIONAL Qt^STtONS - DATA PROCESSING,* 
• If JCCC training did, not help theR qbtkin their jobi . " ' 
• a. Did th© JCCC eouxee work upgrade your pluvious job skill? 
" Ves » No . ' ' ■ 

b. Did the.J'CCC course %ofk help you with professional advance- 
nept? * 



. No " : 



2. What additional -courses would" you like to, have 7 ' - 



« 



ADDlTICNAL QUESTIONS - DRAFTING 'AND, E^CTRONICS P'ROGRAM 

*• • • . ' • 

For Three-Year Pollow-upi 

Question ^2 - Add following questions on the end: » 
If- working in vinrelated area or unemployed ? 

* • 

.1. Since you left JCCC^ave you^evdr worked in a job^related to 
your training?' Yes . No. - , « 

' Why did you change jobs (or- quit working)? ^_ * 



' if working in related area : . • ^ 

1. Is your current job your only job since leaving JCCC? 
Yes . ' No 

if yes, how has. your job, title or your position changed 
since yod began this job? ' . . 



If no, was your previous job (jobs) related to your training? 
Vas . No ' 



Why did you change jobs? 



ADDITIONAL QUESTIC»is - NURSING^ 

In what araa of nursing do you feel you were best, prepared to 
pracliiee? 



In what area of nursing do you feel you were the least prepared 
""to practice? t ' 



If you could add something to your basi'c preparation, what would it be? 



— — ^ ^ - > • 

How do you feel you ccm^jare to. other graduates in your Ability to 
give high quality patient care? 



What was your initial position foilow)jig graduation? 



What is your positicsn at this time? 



. ADDITIONAL QU ""TIONS' - MARKETING AND MANAGEMENT 

♦ 

t 

Would you be interestad in participating in an aluinnl group? 
' Yes .iMaybe • " 




( ■ 

■ . • ^ ■ / 



Question #S 4 Ask for nusdser of College Credtia « 

For One ytfar Follow-uet ' 

Que6t:lon #5 - a;.80 aak for nuiiber of College Credits. \ 
Add after question #3 - If not related to uneaployedT V 

' \ 
Were you 'previously eiqployed in a job related to you^ training? 
Yes Mo • ^ . . " 1 

-If ye?5|^ why did you change j0bs (or quit working)? 



■^Source I Michael Quanty. 197g .fcareer Student Fbllbw-up. Initial ' 
Placement (Overland Park« Kansas Johnson Cdunty Community College, 
1976) . * ^ED 126 999) ' . ' « 
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Powe^rs, .derry and Lewis, James. Followup of Hearing 
lihpaired Graduates of Pennaylvania (l^it^i^i^y , 
Bioomsburg, Pennsylvania t - Bloomsburg state Collegei 

. i976!«. 



A follow-up Bt^dy was conducted of hearing impliired 
graduates in Pennsylvania* The purpose of the Study was to 
father information on graduates and their employers in ordet 
to assist in the evaluation of vocational and academic cur- 
TicuXum, and plan for future programs. A sample of 167 
hearing impaired residents of and graduates from Pennsylvania 
educational institutions Irom 1970-1975 were selected to 
be interviewed (out of A %otal population of approximately 
600) . Four 'basic instruments were used to collect the 
information — a Student Questionnaire, an Educational History 
Form, a Parent Follow-up Survey, and an Emplbyer Survey. 
Face-to-face interviews generally were conducted with parents, 
students and employers. Thus, interviewers were selected 
who had the ability to communicateywith the hearing 
impaired since a face-to-face interviewing process was 
utilized and were affiliated with the hearing impaired, 
in some professional way (e.g., teachers, counselors). The 
following, pages contain copies of the follow-up instruments. 




WOUSM^UP SURVSY W FOI^R VOCATIONAL ST^bSNTS 
(Hearing Xapairdjd)* 



Last 



First 



^ddle Initial 



Married Masse 



Last 



School Sfisidential ( ) 
Day student ( ) 



First 

Day School ( ) 
Day Class. ( ) 
Public School ( ) 



Middle IiSIti^ 



Hooe Address 



Street 



^ty 



State. 



Zip Code 



Parent Address 



, Street 



City 



State 



Zip Code 



Eo^loyer Mane 



Employer Address 
Birth Datet 



Sex 



Soc. Sec. Mo. 



fp- 



Year- Graduated 
Interviewer 



Course 



Date 



1. Marital Status: 



parried 

Single 

Separated 

Divorced 

Widowed 



2. Does your spouse have a hearing ioss? 



No 

Ntanber of children 



Number of children that have a hearing loss 



3. Does your father have a hearing Ipss? 
Does your mother have a hearing loss? 



Yes 
Yes 



No 
No 



4. How wquld you describe your present relationship with your parents? 

' Very Successful . ^ Somewhat Unsuccessful 

Somewhat Successful 



.»yery Unsuccessful 



•Source: G. Powers and JK Lewis. 1970-1975 Follow-up of Hearing 
In^aired Graduates of Pennsylvania (Blpomsburg, Pennsylvania: 
BlSbmsburg State College, 1976). , 



5. NuiBber of fri©hds thit have hearing loss. ' beaf FrieiWs • 

^ ^ . ^ Hearing Friends' * 

6; Nuaber of o^siberships in clubs Ifeaf Clubs 's • 'n 

Hearing Clubs x 

7, Hearing aid? ' ^ , Is wearing a hearing aid 

• . . * Is not 'wearing a hearing aid 

Does «wn hearing aid- ^ 

[ • ' . . :; Poes no^ own a hearing ^Ld ^ 

8. Wnat you like about your educational program? 



What did you dislike about your educ^ional progr^? 



10.^ Stere you ever informed about the edua^tlonal o^ vocational program 

. availabj^G to you? d Yes ', No .[ 

If yes /who inforn«d: Jibu? " o ^/ <. 

*lJi. Do, you feel yc^ had enough information for selecting a senior high 
. px;d^ram 'in college prep or vocational education? if yes, explain 
th/6 type of infprmfition ^pfeteeived. ' 



-r 



12. Are you now sel'f-suppclrtive? Yes No If^o, explain why j 

— : . 

13. Do you feel your vocational training in jsenior high was adequate 
for -today's job market? If yes, eacplain. why you feel training ^ 
was ade<jjiate. , , ' , ^ 



/ — ^ ; ■ r T 



If no, explain why it was npt adequate * ^ 



AT 



14. If employed, please answer. Present job: . 
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15. ^Do you-hav@ a driver's license? 
If y&Q,^ Instl^oted you? 



Yds 

iffii ,1 



Do you own a car? 



Yes 



No 



16. Rasp^id to the following comaunication information t 



* Mai^^l conanunicatioh 

Speechreading 

Speech . 
. Writing 

Hearing 

Gestures 

A. Hark each that refers to yout 



Goo d Average 



( ) ( 

( ) ( 

( ) . / ( 

(• ) ^ ( 

( ) ( 

( ) . ( 



Poor 



I work full tiise. 
I work part tine. 

I do not work-, but 4^ looking for a job. 
I do ;\ot work. J) 
I take care of my hoxise all the time. 
I go to college full time. ^ ^ 

I go to college part tijme.' 
I go to a vboaticmal school full time. 
I go to a 'vocationiil school part time. 

B. Did anyone at yolur school talk to" you about what you would do 
after you finished School,? . Yds " ' No 



If yes, who? " 



Did your school give you a . list of bosses who need workers to help 
you find a job? YeV-"^ ' .. Wo 



Did any possible bosses offer 
Yes No 




a< job befqpe you left school? 
Did you get ■a.-^pb because o,f ^ boss talkirtg to you before you 



left school?'^ 



Yes 



Did your school give you^ loti!.;6f^lp in^.finding a job? 

Very roucb help " '^ .Sorae help 

Much help ■ i ;> '' ^^o help 

• ■ ' - . 

When you l^ft school, did you wa^t a job doing what you did in 
school? Yes ^ No o . 



Do you still want lijob doing what you did. in school? 



Yes 
No 



Miere do you work now?' 



Name of iK>4pany ,05 f ii-;n 

Address \ 



Sane co\inty as school? - Yes ' No ♦ . ' 

Another county near the school? Yes "no ' 

Soaie other county in state ■ ' yes ^ No 

Another sta^d near Yes ^ No 

Another ^tate not near . . , > Yel No ' 

< Did you have a full tine job before you left high school?. Yes 



No 



How long after yoa left school did you atart your first full 
tins job? - 

- 12 w^ek6 

Right away . ^ 6 weeks \_ 14 weeks 

2 weeks ^ ^ 8 weeks j 16 weeks 

4 weeks . ' _'ip weeks nore than 16 we^ks 



How much ilioney do you make a mojithr^fore money is taken. out for ta:ras? 

^low $400 ♦ 50Q-549 ^ 650-^6^9 J. - more 

400-449 ^.550-599 700-749 tl^an 

450-499 600-649 7^0-QOO sbo 



Did your school do a good job in training you for the job vdu have now? 

very good ttaining for present job , 

good training . . ' 

. not so good , • ^ , ^ 

^bad training 



What kind of job do you do? . ' ' (V . 



» 



Do you use what yo\l learned in school in the job you have now? 

t 

The same thing as you did in school^ ^ 
Almost the same .thing you did in school. * 



Soit« of the things you did in school. 
Not what you did in school. * 



\ 





^ tftiat urns • the reason for not getting a job like ^ou were trained 
. ih BchooX? * , 

^ ' I not waiit to do what I was Gained for. 

• I ]M.ed^ but co\»ld not get a job in what 1 was trained for. 

I did not think I learned enauigh to get a job 'in what I was 

trained for. ^ 

Ihe pay was not enough. \ . 

Too little^ oppqttuhity "for advanceneht. 
X would not be able to get a better job. 
X did not like the working conditions. 
I^ot a chaiic© for a better job. 
X. was no^ able to work in the apprentice program. 
Otl^r • • 

How did you get your first full tins job after .you left school? 
Your school helped you 

Vour vocational teadier help^i you 

Your counselor • 

, Other teacher . * 7^ 

Your faiaily, par^ts " i . , 

Your friends , • . * ^ * 

By yourself ^ 

.. Through an office at school 

Through an off ice, of the state.. , „^ • . 

^ Private employment agency 

Through School placement office - V ' . 

What kind of '^school do you go to now? • is it x© 
bo you live at home or at school?* Does what yo^ 



- ^ Doef what yoV re studying now 
have anythiing^to do with vrtiat you were trained for in ikgh school? 

• # 

Community College Location: 
Privat.e 2^ear college In-state 

State college brancH campus out of state 

state college main caa^us 



Private 4 year'^pllege . Residence: \ 

^ Private business school At- home <^ 

Private technical school At school 

Area vo-tech school 

Other school * Relation: 

_ Related 

\ . • • _J Unrelated 

Name and Address:^* 



-^\.' This ia a scale. Please answer the questions onr this 8<3!&le. The 

questions tell us what you like about your job. They tell us what 
, ^ou don»t like about your job. .This scale will be sent to all hearing 

| iai>aired pepple in ^ I We Wtot to find out vAiat hearing 

^^dppaired people like and dislike about their jobs.* ihi^s is con- 
fidential. No one will see. this except us. We will not show it to 
your j3B5)loy3Br;^ 

DirectiQns^ 

There are 20 questions below. Read each question slowly. . Take 
your tijne. ■'Wink about each question. Fill in the circle that tells 
htow you^feal about tAe sentenca. The circles are not the sane. Hie 
circles have these meanings or definitions. 

' ' Sign 

A neans I like this very much Very Good 

B means I think this is okay 

'c means Z. can't decide 
p . means don't like this 

.E means -this pothers me a lot 

Please fill'^n one circle after each question. 
MY JOBx 



Okay 
Don't know 
Don't like 
Vezy bad 



(1) Keeps me busy (activity), 

(2) <'Le<t:8 m work alone. 

^ (3) Lets me do' diffe^rent things. 

(4) Maked me feel important outside- of work. 

(5) • Lets me do thijigs I think are right. 

(6) Is a sure job — I wil^ have this job 
Lii the future. ^ 

(7) Lets me help other people. ^ n- 
- <8) Le,ts'me tell other people what to do. 

(9) Le'ts me 'use *Aat i know. 

(10) Is good pay -.pays good. « 

(11) Makes^me work hard (work incentive). 
(12 J Lets me try thirds my way. 

(13) 'Is a good place to work. 

(14 ) The people . get alaig good. 

(15) Tells me I m> good work. 

(16) Makes ma feel I do good work. 

(17) What ,do you thdnk of conpany rules? 

(18) Can you get better job here? 

MY BOSS-: 

^ 1. Is fai4: to the workers. 

2.' Knows his/her responsibilities and tasks. 



A 


B 


c 
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PARENT FOLLOM-UPNSUSVBY 
(For the Follow-iq? Study of Foxmaz Vocational' 
Students Classified as Hearina Inpaired) 



Nana of sof^daughtex 



son/daughter namdd above* is adopted^ please chc^ck here 
le Mother age Father's age 



2. Parents* marital status i 



Married 
ivorced 



Single * 
Separated ' 



Widowed 



3. Mother's hearings ^ Npjnnal Hearing _ 

Please give age vdien hearing loss occurred: 



Hearing Ziqpaired tor Deaf) 



Hearing Isqpaired (or Deaf) 



4., Father's hearings Norxnal Hearing j_ 

Please give age when hearing loss Mcurredi • 

5. What is the hi^est grade you and your spouse completed in 

school? (Check the correct line and then cir61e the last grade 
completed) 



Mother 

Grade School 

12 3. 45678 

High School 

1 2 3 4- 

Vocational or Secretarial 

1 2 3 4' 

Colle^yU]?iversity 

1 2 3 4 5+ 

School for Deaf. 



Father 

» 

Grade School V 

12 3,45 6 7 8, 

High School 

12 3 4 

Vocational or Secretarial 
1 2: 3 4 
College/University 
1 2 3 4 5+ 
School for Deaf 



6/ Father's occupation: 

a* What is the usual occupation of the father? 
b. What is the current occupation of the father? 
* ' same as above unen^loyed 



other 



♦Source: G, Powers and J. Lewis. 1970-* 197 5^ Follow-up of Hearing ^ 
Impaired Graduates of Pennsylvania (Bloomsburg, Pennsylvania: BlCk>msburg 
State College^ 1976) • ^ \ 
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7. Mothered occnnatitmt 

a. iCAiat is the usual oocttpa^on of the it»ther? 
Fil'l tiao housewife 



^ Other (describe) 



»»at ib the current occupation ^of the »other? 

# 

Saine<as above, ^ ' ' 

Unenployed 

Other (describe) 

t • — 



8. Please check the ^propriate box indicating your total, confined 
family income for the past twelve (12) oonthsi • t. . 

* « $5,000 $15,000-19,000 

/ $5,000-9,999 $20,000 and over " 

^ . ' $10,000-$14,999 . . ' % 

9, What i'a the hearing loss of yotur son/daughter r . 

c 

Right Ears ^Normal Severe 

' Mild ' . Profound 
Moderate » 



Left Ear: Normal 



Severe 



Mild • . Profound 

Moderate 



10. At what age was your son/diS?>ghter when you discovered his/her 
hearing loss? . . 
At birth 

Years of a?^ 

11. At what age did yo\ir son/daughter lose his/her hearing? 
At birth \ . • 

Years of' age , 

\ Age hearing was lost is unknbwn, 

12. "^ Cause of child's hearing l,os8: ' - 

Cause cannot be determined. 

If onset at b|.rth, what was the probable cause? (check all that apply) 

Maternal rubeH'a \ 

Traxana at birth 

. Other complications of pregnancy 

Prematurity . ' 

Heredity 

^ Other (specify) 
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t^at iD^thdds of. Goamimication do you use moQt often 'when com* 
municating with yoxur hearing in^ired son/daughter? 

Speech PlngerspelUng 

Sitm Language Writing Gestures 
Other (Describe) ' . 



ti&)at methods of communioation does your hearing inpaired son/ 
dau^ter use \i^en he/she coomaunicates with you? 

Speech Pingetspelling ^ 

Sign Language . Writing Gestures 
Other (Describe) ' 



Have you had any formal training on how to communicate With 
your son/daughter? __; Yes No 



If yes, viAio provided the gaining? 



Wiat did you like about your son's/daughter's, secondary 
educatimal program? ^ ' 



What, did you dis^ke about your son's/daughter's secondary 
educational program? 



Wereo you ever informed about the educational oi vocational 
prbgrams available to your son/daughter? Yes j No 



If yes, «^o informed you? 



Do you feel your son/daughter had enough infor^wtion for selecting 
a senior high program, in college prep or vocational education? 
If yes, explain the type of information received. 



Do you feel your son's/daughter's 
high was adequate for today's job 
you feel training was adequate. . 



vocational training in senior 
market? If yes, explain why 



If no, explain, why you feel it was not adequate. 
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21. 18 your aai/daughter now self-supportive? J ^-Yes . ko 

" ' . • • • . 
* If no, es^lain .why... ' ' . ° . * . . ■ ■ 



22. Do you feel there ^s a need for fcllow-np services to help your ' 
pon or daughter to advance and obtain a. better job? If yea, yOiat 
type of services should be given? . ^ 



7 * 



23. Does your son/daughter Arive a car? Yes No 

If yes, who trained hinvTher to drive? . 



'24, Does your sony/daughter own- a car? Yes No 

^ I • * . ' , ' 

25. What mode of rransportatio^i does yoyr son/daughter use to tra\fel 
to* woi^? • ' ^ . ♦ 



. - • • • - • . ^ 

26. • How wo\ild>ou describe your present relationship with .your eon/ 
daughter? V 

4 t 

Very Successful • ' Somewhat Unsuccessful 

Some**iat Successful Very Unsuccessful 



) > 



. t 



ft 
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(For the Follow-^up Stud^ qf Former Vocational 
Students Classified as Hearing IiopaireS) 



pi^loyer: ' 
Address t 



Street City Siate . Zip Code 



lephone i ,. J ' ' Date % 

No» of ©iiployees: / 
Mo. of hearing impaired e|aployedt 
Employee t 



p — ^ 



Interviewers ^ 
Entry ob : 



1* Was he/she properly trained? ^(high school program) 
^ A* Skillwise ' ' ' 



B » Oh appropriate e'quipioent ^_ 
C' Additicmal training Acceded 



2. Was job reengineered? * Yes No 
To what extent? 



3* What 'relationship is there between the^disability and job employee 
is performing? v ^ • 



4* Has employee made any advancenfent? 
A* Skillwise \^ 



Job classification 
. C* Salary 



/ 



■ ■ — — 



*Sourij6; G. Powers and J.. Lewis. 19 70- 19 7 5 Follow-up qf Hearing 
Impaired Graduates o- vennsylvania (Blodmsbur^g, Pennsylvania: Bloomsburg 
State College, I976) . . ^ ■■ ~ 
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5. SuccQss of our graduates in con^arison to hearing ^workers': 



" 'Good 



Poor 



A. Quality of ^oxk 
B/ Quantity of work (productivity) 

C. Handling of equipment 

D. , Attention to work , 
•E, Attitude toward work and initiative 

F. Attitude toward supervision 
6. Relations with co-workers 

H. Accident rate 

I. ' Absenteeisiti 

Would you consider employing another hearing i9«>airedAandicapped 
person? Yefe No ^ . 



» .4 



7. .If answer is yes, what kind of job? 
6. If answer is no, v^y not? 



7" 



9. .Have you hid previous experience with the hear^.ng iaipaired/ 

handicapped other .thah this employee? Yes - No 

What? 



10. Do Vou employ^ other handicapped workers? 



Yes 



; No 

Number 



11. 



12. 



How did you' find this person for en?pioyment? (Agency, Friend, 
Newspaper, School, etc.) 



I 



Do you feel the hearing impaired individual has had a pirbblem 

socially adjusting within the ccanpany? Yes */_ No 

If yes, what steps were taken to help with the problem? 



4 
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i«| f|«|iM (Of tO(«l<Ol»tt 



INITtAL roUOW*UP SURVEY Of PORMEil VOCATIONAL 8TU0ENT8 




it Voiir Namt ami Addmi Corrtet at PHiitad Abovat 
H aati plaata iirtiit tHa aantatatf infarmatioii baiawt 



Name ^ 
New Atfdrast. 



€<ty. Tovft or IN)tt OlMo 



DmCCTiONS. 



WHEN ASKED TO ''CHECK" A BOX. I»LEASE USE AN **X" TYPE MARK. 

WHENEVER tHE WOROS THIS VOCATIONAL MOOOAM APPEARt THEY REFER TO 
THE VOCATIONAL PROGRAM PRINTED ON THE IDENTlFtCATlON LABEL ABOVE. 



Smce you left tt»ft vocational program, dtd you seek 
ty||«ttflia employment? (30 or more h^irs p«r week) 
□ ve» QNo 

. if you M aol seek fuU-time employment when you 
left thift vocatipnal program, indicate the reason 

Check ortly one box 

J n Eipected to enter another whooi 
« ^ Housewife or at>out to be married^ 
Physical Of other handicap 
Not interested m a job 
Cipected to enter the mihtary service 
Of^ty wanted to work part-time (less than 30 
hours per week) 
^["] Other {specify) 

Old fou^k part-time employment (less than 30 
-<iwf» per iv?ck) *hen you IcH Ihi^ vocational pfo 



If you sought part'tiffia employment, instead of^fuH- 
ttme employment, when you left thts vocational pro* 
gram, indicate the reason. 
Check only one boi 

Expected to enter another ^hool ^ 
Housewife or about jo be married 
Physical or other handicap 
Not interested m a full-time job 
Expected to enter the military service 
Unable to fmd a full-time job 
Other (specify) 

How many fyll'time j^bs (3C or more hiLrs per week) 
have you held smce yo^ left this vocational program' 

□ None J 

»M I 'ull lime job 

tuU ttme jobs 



NOTE: If your answf*f to quesftof) b was NONE, skip to 
Question 16 



0 




6. »»l««'l««»WMIlll«J»b«rtw,«il«fl|W«WMlteiWl 




r How elsseiy ^uS ^ fM fiilMmt lob (3D or fiw» 
Ntttft per wtfW afttr Ita^ing tNt voetttwi*! 0^ 
gram relate to t^ tralf^ yoM rocoivtd? 

» Choelitf^hronotai 

\ tm Bpi^ in tt)o oecupitloii fw whteh I 
was traifM by tMt maticpa) provam 
*n r wia Ofi^t^ In a rttaSd oceiuMtion 
»□ t was m^pl^ in a compiota^ tfifhnmt eoeu- 
patton 

t Ditf this vaeatioi^ Iraming pregrm adaquotaly pro- 
pafo you for yowf iftt umm Job after Itavinfthit 

trammg? 

.□Vat QNo 

fyH-ttma io6 tinea Itaving thit vocational program? 
Chacli only ono ^ , ^ 

n ll Morfattparhour 
U.iCtp 11.99 par hour 
».00tott.49ptrhour 
$2.90 to 12.99 par hour 
tl.OOto|ll»parhour 
I HOOormorapor^r 



6^ 



10 



Mow M you i»t yinir fliftt fulMinta job Iftar laa^ng 
thi^ vo.:ational training? 

CHacfc approprifta box or boxat baM 

Jgptttiajobmytalf 

My family or fritndt haipaO me gat tfw Job 
Tha job piaeament lanricat provttfad by th9 
•chool naiped ma gat tha job 

□ The tUta ampieyment tarviea helped me aat 
tha job . 

□ A pf fvata employment agency helped me pt 
the job 

□ Other (tpecify) 



II What >| the matt you have earned on a faH*tlfiia ioo 
ttftce leaving thi« program? » 
C^w^l only ore box 
^[J II W Of }tt% per hour 
> per hour 
J per hour 
^ per hour 
1.99 per houf 
r more per hour 



^rj II 59 or Jew 
'□'$Ja0to|l99( 

>□ $;ooto$2:49j 

*n 13 00 to 



il HyouhavaMdlMorfiMreMl^^ 

boiirt prjMak) ginee yow ended ft^ voeattoiial bfifi» 
inacbaeiiombQibaloiy. 

< wat trained in tcho^ my last Job 
tQ^ latt job w8t related to thit voeatiofial train* 
Ing 

My Ian job wat n^ at all related to thit vaca* 
ttenpi training • 



U Indicate below the tecatten of your presents moM 
. mmt fy|l4ima employment 



0 



14 )f youam^nattHy worlUnit whatltyour jab? 



11 What fngaa m you preaently eamii^f 
^ Check only one boK 

^ □ $t.99 or lets par hour 



IIA) to 11.99 par hour 
fSJOfo 12.49 par hour 
fStSOta 12.99 par hour ^ 
tlOD to $199 par hour 
IMD or more par hour 



tamunempt^ad 



16. Jfhat IS your currant ampfoymant atitutt 
Checli the appropr late box or boxes below 
, Q I am employed 

□ futl»time (30 or more hourt per 

week) ^ 

□ part'time (less than 30 hourt par 

week) 

□ t am unemployodt 

□ but looklnf for work 

□ fln<{ net leaking for work 
^ □ I am m the military tanriaa 



/ 



mm%i wefe provided by the scoool and the matien^ 
.%) pwrsm m whtch.ywi iNereUnrotled? 

) □ A Hhoel placement service coof«lmated with 
the State Cm^yment Service 
ri V'^ajionai T»Khw heined oiace students In 
iOOs by m«#««»^ refeffais & 
Qutdance G^nsetors helped (tuder^^ find jolM 

Q School had no ptacement s^tcee 



la After you get yoyr Urtl jot> (fulitime or part-time) fdl* 
iOMing this vocattonal training, heve you ever Again 
used any of the fbli placafflafit lanriaea provided by 
;he school or thts vQc;ati(»iat program? 
□ Yes □ No 

1/ yes, check the sen^iceCs) you have used 'since getting 
your Ur^X job . . 

[j Coordinated servtce provided by school 
and state employment service 
) n vocatrona) teacher assistance 

. Guidance c^nseior assistance * 

□ Other (specify) 



19. H9t$ many separate vocationot^tcourses did you talte 
(Mhiie enrolled tn this voeattonat program? 

Courses 



20 Old you enroll m this vocational program with the 
specific purpose in mind of getfing slitit training In 
order get a |05 in this field. / 

□ Yes □ No 



2\ Were you satisfied with the vocational training you 
received thii program^ 
•[J Yes QHo 



22 \^ouid vou recommand this vocational program to 



□ Yes □No 



H ■> n. H ip't vocational progfam. have you en- 
r..> .A af^y atfdttien«t .education program(s}' 



: No 



2|. Comifiued, 



If yes, check ty({e(s) and purposeCs) ^low: 

□ Qenaral aduealiM prvgratnta) ^ 

To raise my general education level 
Informal, nonrri»dit course(s) 



□ Ve«ati«iut propamtt) 

Q To upgrade thervouttonal ali><>% pre- 

vioutly learned m this pr^ra'm 
Q To learn a new occupation 

< 

What ' type(s) Of vocational training pro* 
l^amta) did you attend? 
n Private schooKs) 
Public schooUs) 
Business or Industry 
%* ' . 

24. If you did enroll for additional edimtlon after leaving 
this vocational ^^am, have you received <or do you 
expect to receive) one or more of the following; 

□ Yet QNo ^- 

If yea, check type(s) 

□ A certtf^ate (type) 
'0 □ A dtplwna (type) L . 

□ A 2*year associate degree Tr^ior ) . J . 

^ □ A 4-year college degree (major) 

□ Other (specify) ' , _ » « 

« 

^21 Are you now j^nrolled m a vocatianat program? 

□ Yes □No^ 

2^ Are you now enrolled in any aducatlanat program(s) 
other than vocational? 
. QNo 

21 Are you interested m getting, mere vecatienat tram* 
mg' ^ 

□ Yes QNo. ' ^. 

28. Are you interested m getttn|^9re general education? 

r, □Y« 

29. If you are interested tn getting mere training of any 
kind,. indicate the type you are interested in- 



ror St*t« UM only 
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aa WHil ipectfte tWiip about this tm^loittl preerm 
hyrti y fti tow^ to bf ^ fiwtt umM to yon m your 



7 



31. What iptcifk thiftp •tewt tfHs vocittoval pragntn 
ha¥« yoM found to bo tho looit moful to yoi^ to yow 
proiont |Obf 



£. BoMd on yoer ^Nper^ftoes, wtiolMggOftiont d0 you 
Hivo fm improvmi Oilt vocational prognwiF. 








4« 
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PLEAtK LEAVE ALL 

FOLLOW-UP QUESTIONNAIRE 

ALL RS^i^S WMiCH YOU QlVg WiU Bi tCiPT STRiCfi^Y qONfiOiNTiAL 



(141 

''-CD CD 

Month Yeor 



GENERAL DIRECTIONS: Plea» complete ALt actlom that apply. When you have oompMed the form return it in the enclosed 
4^ return*e^ressed. star^ped envelopd. Your frank responielt ventr importani in order that the ares voca- 
I twnaUechntca^ institutes may continue to Inrtprove their proyOTS* | ^ 



♦J 

1/PERSONAU INFORMATION 
A. Name 



C. Present Address. 



(First) 



IMidtfie) 



Xl^ B. Soc. Sec, No. fTTirl | [ 



^ ■ 



(Street Rural Route) 



(City) 



0. Home Phone, 



(area code) 



(State) 



Wortfphone , 



(area code) 



{up code) 



II. ADDiriONAL TRAINING 

.A. Since atfending^the area vocattohal-techntcal institute, what further educational training have you taken part in? (You may 
check more tftan one.) - 



i^^ij I I None 



^ ^"^^'^^^^V' coltege and/or junior codege programs 

>, 

^ti>i ' ] On-the-job tiTfiin me (smpioyer sponsored tramirtg program) t32)|~i^ Apprenticeship 

' ^ Public area vocational chooi programs ^ (3J}|j j Specialised occupational military tcatning . 

1 ^ Private vocational programs > ^ J Other (yacify^ 



HI EMPLOYMENT INFORMATION Present status 

A Are you presently employed, unemployed or unavailable for employment^ (Check on^y one of employed, unemployed, or 
unavailable for employment.) 

Employed 

Unemployed i Yuu are actively looking fOr a i >b but cannot fifx) one ) 

Unavailable for employment f.You 'cannot accept a job for one of the following reasons. Please check appropnateVea^on.) 



) Military , 

'J Fufther training nf imIhc ition 
i Illness 



! 4 j Housewife or piegnancy 
* ' Pf»»s<*ntlv fK-t inq irid nut intef**stetl n e«npJt»v'"«*' ^ 
Othei i _ .. 



Katitjruilf* and Mot.h< k1j> 



(Mirmeapoi isi : nniversity of Mitmcf^ota, 1^«73) , 



[.}'. fM-oJ. '7 pninnuriion from Oavid J, Pucel, University of Minnrsota, 



IV. JOB INFOR«ATldN: (IF YQU HAVi NOT BiEN EMPLOYED AT ANY TIME SINCE GRADUATION FROM THE AREA 

VOCATIONAL TfCHNfCAL INSTITUTE, SKIP TO SECTION IX, p. 4.) 



DIRECTIONS^ 1. If WW ^ployed at aay ttaw since ^aduatir^ from tfw df«d vocational teehnieal m%t\xuxe, compter the 
MlQWing section of uto (^ottwinmrB, 

2. Please upply the requened information for. each of the folkwirtfl jobs held during the time since graduating 
from the area voeationdl teehnttdl institute. (Include names and addresses,! 



(!) First Job 

(ftrst job after teavirq 
vocational lehooi) 



1371 


(41) 


INI 




(42) 


144) 








□ 


S 



(2) Present Job 

(job you are presently 
employed in. If same as 
first job. write SAME.) 

ibO) (54) 



Firm Name 



Firm AcMress 



Ci^ 



Job Title . 



Job Duties . 



Immediate Simrviior . 



cm 

(58) (50) 

- □ □ 




Name 



Firm Address . 



Check one: 

(T) Full-time iob ' 
[T] Part time job 
Check one: 

I I Job related to training 

i I Job not .related to training 



Number of months in ,this job 
since graduation from vocational 
Khoof 

(48)i49] 



City 



Job Title. 



Job Duties 



^ 



Immediate Supervisor 



Check one: 

1 t Pufi nme job 

' ' . j Part time job % 

Check one: * ' ^ 

'I • I Job related to training 

I Job riot related to traimmg 

Numi)er of months in this jot> 
since graduation from vocational 
school 



T 



(3) How many jobs, including your first and present jdb. have you had since leaving the area vocational techmcSt institute?! {_} 

V ADVANCEMENT INFORMATION 

A Have you a formal wivencement in job classification (other than just salary increases) since taking your firit job ^rei; 
ieavmg the area' vocational technical institute' ♦ . ♦ 

i54) 164) 

B NOTE The following item need not be completed if you prefer not to complete it. Please do not include overtime when 
calculating your monthly salary. (Check the appropriate scHidres.) 



First Job Monthly Salary Range 



Present Job Monthly Salary Range 



wJ/f/i^lllli/i "" 



— f— ] — t — -I — 

A.. L . _.t J i 




01 O; 03 94 OS 06 07 08 09 , tO 11 



7 



VI. Job 8ATI8FACft9)«iSURVeV'. OP VOU ARE NOT PRE8ENTLY^MPkOV£0. SKIP TO SECTION VH I 



m '2» 



OtfliCTfO^i The puf^so of lurvev ^ to enoWe you to eK^'d$i^ fillings of^^diif faction or dli&tisfdctictn ymtti 
' your ^menx job. Ptedie anmer oil qi&$ttoas by Rteeir^ an "X'' in tto dopropr<ai6 squdid. ^ 



A* H&M do you feel about youf prattnt iob' « i « 

Lik6 It very^muet) ' {4] Oiihke it s<^fkdyvHa{ 



["2] Like it somewHat 

[ 'ij NeitjRer like nor cfi«like it 



[^J' Oistike It very much 



B. Conttderins the chan^teriitiwof your iN^ewnt job. rfte the degree to which you are satisfied with each of the following: 



Sat-'' Not . 0|ssat> 

« isfM iSure itfied 

'•Saf^- □ Q] [3""' 

2. Frtnp heTOfi.U Q 0 ,00*"' 

3. Potwitial for adwancement [t) |T| (]]] "2) 

4. Superviwon and maij^Binpnt . . . [J] ' [Tj(ni 

6. Co-«*orker» [JJ 

g. Company polictst and prwtices . 



[T{H4) 

[T] n&» 



Sat- Not Dinat- 

itfted Sure ■ MM 

7. Pace <«pe8dj of work .' [jj Q] [1] < ib) 

8. F Mil iti«» and equipment (Tl ITl fTi(i7i 
with which to dp^*e job uJ LU LJ 

9. Working ojhditions [J] 0 Q]""* 

10. ^arietv <rf work tasks [T] [T], QT) i i«J) 

It. Job security [T| (T) [T](20i 



12. Safety conditions . 



TRAINING PROGRAM QUESTIONNAIRE: (IF YOU ARE PRESENTLY EMPLOYED OR HAVE BEEN EMPLOYEb AT ANY 

. TIME DURING THE YEAR SINCE GRADUATION TROM THE AREA VOCA- 
TIONAL TECHNICAL INSTITUTE, COMPLETE THIS SECTION OP THE 
. QUESTIONNAIRE.) 



6 ^ 1— > ■- y ~ 

OIRECTjO^NS. P\Qam answer ail of the following questions concerning the. quality of the curriculum and the quality of the facilities 

and equipment associated with the program from which you graduated. Pl^ce an '*X** in the ^ropriate square. 

♦ • ^ . ■ * . *• - ■ — ■- 



, VII CURRICULUM ^ * 

A. In ligBt of your experience on the job. how do you feel about the trainir^ you received in basic {ob related (performance) 
skills at tl% area vocattonal technical institute? 



* ! Excellent 



\ ? 1 Very good 



[ ^ i Adequate 



i 4j Inadequate 



B. in light of your experiences on^eiob. how do you feel about the training you received in job related general technical 
knowled^ at the area vocational tectfn^al institute' 



"1 ] Excellent 



[J] vyv good 



Adequate. 



1^4 J Inadequate ✓ 



Vlll FACILITIES ANp EQUIPMENT 

A^ The equtpnient at the ar 4a vucatlomat techmc*al institute in my training area was such that : 



I. Ml 



I ] I foumi It very easy to adapt ^to^^ equipment on the |ob 



j I found it very difficult to adapt 
J to the equipment on the job 



1 / i I had some problems ddapfing to the equipment on the }ob 



B In companion to ttw facililtes and equipment u«d on your present |ob. how would you rate your area vocational technical * 
mstttute fac*httes and equipment^ ^ 



^ t j Area vocatfonaJ. technical institute facilities and equipment were superior to those on the job 
1 ] Af^' vocatu^n|i technical institute facilities and equ^^ient were s<rT4lar to those on the job 
f . ' Area voiatio*:al tothnical mstitute fac»ia»es ami equipment were mf^ior to thc« on the jOb. * *' 
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THIS SiCTION IS TO 86 COMP IBTEO BY ALL 

OlffeCTIONS: W8<w«M*wr all Qft»>» tnti#«^i.:««..^i^:.. . . . ' 

tfw tdHw^fr^m t»hteh you yaduata d. Plaa> an "X" in the appropriMi mtn. 



«X. INSTRUCTION • . 

'—"«*« "rtl«HW;«ol. _ lildHnoltMchiwII. 
a. ^ ,^ ,„«^ „ ^ p«Ld *^ 

I — ! knowtoc^able «$ ware npt. XiU**^ knowledseable, 

. VES □ NO Ef . . 
XI. SCHOOL AND COMMUNITY SERVICES . ' P 

.. A. Who was the greatm h«lp to you in ncurins your first job? (Chedfone.^ 
131) / ' 

rnlnttructor. erotharareawocattoial- * pU 

L-Jttchnleal institute personnel ' [iJState employment agency ^ ' 

[iJPrivate employment asency [i]Other__j_ i««w..«.« 

Relatives or friends [T|2"»'«»|.«Wlx<l have not been employed during 

8. How would you rate the qu^fity of the followina mrykM m ff»r«uM«^ , - 

Excel not • e . ' 

lent Good Poor uibiv „ not 

1. Job Placement Ill . HTl ITI 741(321 « u . . , °r29J* PSST "ffiiv 

2. ^n.elirswith ^ S ^ 6.Helpln.ecurln«ho».lng...Q [T) 0^,37, 

■ 3.fefe"''-g H''^' 7.Youthor,an.„tioi. []] [l] [i] {T],38,- 

4. ffirnfe4p..t-S g § S'" 8 Recreational programs..... 03 [|] [3] [TJra^, 
.^.m^emSTynSit 0 0 m<35t 9- Study, library and other m m m ni 

5. Help m Obtaining 7=; ^ ^ ^ <«»w«nfl resource facilities .. LU H] [ij . Hwo) 
financial assistance.. LU Lil GU [4j<3e) 10. Health services • • Q] . [E '[l] [TJmii* 

Does 

Exesl. not 

lent Good Poor apply ^ 

'•■^"«<"S □ \j} g] [T|(42, 

? Job opportunities . . Q] [7| HI B'^i 

3. Recreation facilities • 0 [7] [3] [T[i44i " » 
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WidMii^ of Wn n { W tt ^ ^ 



^ - 19, 

" " 44i MSPOfms YOU otvs mu e§ / ' 

^ 9(6^ SrmCTLY eONftOBNTiAL 



# 



EMPLOYER QUESTIONNAIRE 



ClIRECTtONS: Ptesse complete ALL sections of&this fprm even if t|tflfi%mployee no lon^ vvorfcs for your firm. 

Wlwn you hewe mmpleted the fornn return it in the enclosed re^riyaddressed, stamped emwiope.' * 
Ymir re^omet will in way iff eer the employ Qi, 



1. PERSONAL INFORMATION 



A. Employee name. 



(Last) « (Firitl, (Middle) 



B. Indteatad ErvH^loyer City . 



> 



II. EMPLOYMENT INFORMATION 



If the employee has ¥W)rked or works for your firm, pleue have a supervisor familiar with the work of the employee fill out this 
queitionnaire. 



Employee's Job Description. 



Supervisor's Nam^ ^ ^ OaX%^ 

<»-^t) (First) \ (Middle) 



Supervisor's Position 



PUASB COMPLETE REMAINING PORTIONS OP THIS QUESTIONNAIRE 

*■ 

Not to b9 fgprottucad or used without wrttton p»rmit$ion from th0 Vocational follow-Up Syttvm. 
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9 



FRir ^ 



EMPLOYEE PERFORMANCE SURVEY 



OIRECTIOfIS; Pte«t> ntisfaetton with the employee m compared with other workers in the same work 

orw If thetjwAer is the only person emptoyeil with your firm, compare him with o0iers who hav& 
riSt^ii?* mforrnatten ^ili be kept strictly c^n«^tial. Ptoase respondtp 



' I. Total number of rnwitHs employee has been employed byyour firm . . . | \- | n3-i4) 

PLEASE RESPOND TO THE FOLLOWING QUESTIONS BY PLACING AN "X" IN THE APPROPRIATE SQUARE 

you rate the employee on each of the followii^' 



II. In comparison with other, workers in the same work group, how woukJ 
ohanfeteristies? 



1. The quality of employee's work . 
Z The quantity of whployee's work 



^ -^tttb ^ ^ ewpleyee possesses specific iob-related knowledge importaht to success " [T| {2] [J] n?) 
4. The degree to which the employee is able to operate the equipmew and apparatus used on the job . [T] [T] r. [3] 



above abnot betow 

awjaae a yerao e av»are 

Dj .IK . 

CD [U HI M6» 



B. The degree to which the employee possesses basic reading, verbai and computational skills Q] [T| [3] 



118) 

<id) 



llirin comparison to other^in the employee's work group, how would you rate the employee on each of the folk>wing eharacterW? 



1. Willingness to accept responsibility 

2. Punctuality ; 

3. Ability to work without mj|:^tgion 

4. Willingrw^ to learn and improve 

5. Cooperatton with co-worker t 

6. Cooperatk>n with management 

7. Compliance with company policies, rules, and practices 

8. Work attendance 



abow /ibout 
average average 

• CD m 


belbi 
avera 


1 (201 






(211 


• Q a 


m 


(22) 








(23) 


• m m 


m 


(24) 


CD 2 




3 


(25) 


HI 2 




3 


(26) 


m 0 


m 


(27) 



IV. In compar,«n with other worker, in the same work group, how would you rate the employee's over-all competency, effectiveness 
prof ««incy, general over all work attitudes, and other elements of aiccessful job performance^ ^^I'veness. 

Qj In the top 1/4 

^ In the top 1/2 but not among the top 1/4 

j In the bottom 1/2 but rwt among the lowest 1/4 

[±\ \n (h9 lowest 1/4 
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»J>r 



CQMfUTtiMLiAfift rouonup niiii 

MOTI repdft m autrtonied ^ taw (20 USC 33ta aod 20 USC 2391 ) \l(^f}0 yoy am not recrittred to to 
survey, yw atopefifiKm ts fte^ ^ {ftsur^ mat it^ resute ol> tilts ^oft are ^H^reiiansive. 
reitft^te afid time^ AltiS ts to Mrate tfta tfata items necessarv to report to NCfS only ano therefore 
ffiuM oe ifiduiied m tfte ^sign your ow» forms ) 

1 vyria! is your current educatior) status^ {Cheek one» 

Currently attenftng school 
<^ol current^ atter^mo scfioot 

2 , ^ '<d ts your current ^mpUiymem status^ (Check one) 

{m^ioyad (tnctuoes ail emotoyment. even if t^tow your ouaiifications. does not mciude \\f^\A\m 
mrittary service f ' , . . ' ' 

fulf'lwne military service 

Unem^oyed (Not eif»o(oyed. but actively seekino empioyment ) 

Not tn me latK)r force (Not employed and not seeking employmem because of choica. iitness. 

tu^htime student status/retiren^nt. preoftancy or other suet) reason j , - ' * 

NOTE If you are cui^ntiy employed, please answer the rema^mng questions Otherwise, skip the remaminQ* 
ftems 

3 Please provide the toUowmg information on your present {OP 

Name ot Company pr firm (if seif-jemployed please write self) ^ 



Company or hm Matlmg Address 



City 



State 



Zip Code 



You' immediate Supervisor 
las! Nartie . 



first Name 



Ml 



PRESENT JOB INFORMATION 

'joO Title 
Job Duties 



4 \% tnis ,oD related to your field ot vocational tratnmg'> 
Ves w ts directly or closely related 

(t IS only remotely related or \% not related at ati 

•) W^d' s yoij' (urrunt salary' iDo not add jn overtime} > ' 

S pi*r 

^ Th»* ,^>4fv ir^e ofKfdmg item us d<4set1 on how many nours pet Aeeit employment'' 
hours pi*! ^ 



It:a??« t '-. ''^"i "»urh Inr yoU' r.mpprdtinn Plpti-.t» f*»tt»ri: thi\ torni :ii the enclosed envelope 



,::i>urco: National Center for Education Statis'ttfcs^ Vocational Education 
Dcita Systom, Department Health Education and Welfare* H ot^e this form is 
* ^;^'^^^> ^"^^^<^V <^ppr ^^ from the Office of Management and Budget , 
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m OFFICE m OWLY 



sun 



ift^ suMif. your mpsmtmn is oe^M to msum tM ttm mulls of tfite effen im 
reoiftie, and itmsly Tha fwm €oma^$ w ilu^n^smHUM intemtttton. Tfw co^ mimtof m tfte 
I'p^ n#-*l»^«fw csmams Afdrmit^ of tt» pro0wn m wh^ the intftyMual wis wfoflsdj-ths * 
pwe pfotpwn. and olfw dmoQitiri^ mforma^ wftett «di aoow wortionai ^watdfs to 
mme m effedivanass of matr prognms. fio p«t of the co^ com^ studom ^ii^rs. 
eovar Mar bafora mtummg tofm . , 

t voMTioittLifunaoniu^ 

PUwa rata the irootttnaf trawmg reeawed the »tdivM(^ tn the fotiowmfl amas: 



a Tesfm^j hnowtodte 
b Workaitituda 
€ WorJiquaUty 





rOood 




Poor 


Qood 








□ 


□ 


,□ 


□ 




□ 


□ 


□ 


□ 


□ 


□ 


□ 


(5) 


{4)' 


(3) , 


(2) 



Poor 

□ 



WW 18 your ovwstf fattng of the voeahoiMi trnmng recened by th«i individual as it rel^ to th» 
n^uittffltms of hts or tnr io6? 



Very Good 

.□ 
(5) 



Good 

□ 

(4) 



Ham} 

a 

(3) 



Poor 
.□ 
(2) 



W»r|j_Poor 
(1) 



R&KmimMMTnM 

As a f»8uR of this pwsons wcational tramino. how would you rate his or her prepvation m relation to ottwr 
employees i^ his or her work group who did not receive such trammgf 

□ No tusis tor companson ^ 

tS) □ indwiduai ts better prepareid 

Ot □ Both are ^ut the same 

H) □ Individual IS less prepared 



•KCS ^<n< ZttU* P19) I on 



Tims rtcol « lumorittd tV K t*-tt2 (tO U8C 2ffi1| 



'Source: National Center for Education Statistics^ Vpcational Education. 
Data System, Department Health Education and Welfare. Itote thi^ form is 
Bu{3ject t o final approval from the Office of Management and Budc et. 



APPBNDIK B 



Pre-Pollow-up Letter ^(While."in School) 
Request Permission for Participation j 
Letter . for Parents and Students 
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SCHOOL LETTERHEAD 



March 1978 



Dear Parr .^t or Guardians 

The XYZ bepartmen^pf Education and the local area vocational- 
technical school y^^^ your son or daughter attends are veify 
interested in eva^xfSfing vocational educatioh with the intent 
of improving those program offerings for students'. 

The name of your son or daughter has been seleqted on a random 
basis to help complete the study. The information he/she 
provides will help evaluate the program with the aim of 'im- 
proving its effectiveness. 

f> - 

All information provided by the student is strictly con * 
fidential and his/her name will not be associated in any way 
with the information given. 

Your permission is requested to allow your son or daughter to 
participate in the study where the following instruments will 
be administered: Exit interview ' form and a follow-up form, 
one year after graduation. 

Please check the appropriate box below signifying your approv- 
al or disapproval of this request, sign the form in the space 
provided, and return permission form in the enclosed envelope* 

Thank you for your valuable assistance in helping to improve 
this portion of vocational'-technical education for youth* 
You may withdraw your consent at any time. . Please feel free 
to call me if you have any questions about 'his effort* 

Sincerely, * • . 



Director gf Vocational Education 
ABC Area Vocational-Technical School 



n Permission I ] Permission 
Granted I I 



Not Granted 



Parent./Guardit.- \ Siqnature Date 
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school' letterhead » ' ^ 



April 19, 1978 



Dear Student t 



Iit:s^^L^?'*''^f"^ °^ Education and your 'local AVTS are in- 
fbout six «o„ths afte? leaSi'g BctttlT^^ll' b^Ui^ 

Thank you for your time and consideration as this effort ^« 



Sincerely, 



* A 



Director of Vocational Education 

ABC Area Vocational-Technical School ' V 



Sirs: 



Llir® ""tf^ helping determine howwelX 

elude me in the session (s). "'-^^ing rne study to ::,n- 



Signed J 



Print Name: 



PERMISSION TO INTERVIEW STUDENT* 



Read th@ following stat^isent ,to tha stu^ntt 

The ABC vocational school in cooperation with training institutions 
of th@ deaf, are conducting "a follow-up survey of hearing impaired young 
adults. ':^is survey is part of an effort to gain nuch needed knowledge . 
about hearing in^aired persons and provide some new insights into o»thbds 
to improve the educational opportunities for all hearing inpaired persons, 
and to' aid in in^roving their labor market experiences. ' 

We hope that you will assist in our research by allowing me to 
ask you some questions about yoxur educational progrelti en^loyment 
experiences. All the ijiformation which you give to me will be held 
strictly confidential and will only be ,used by those working on th^' study 
to prepare statistical summary information. All of the information will 
be analyzed on a sumnary basis and i^o individual or agency will be named. 



Student's Name Date 



Interviewer* s Name Date 

• EM^^OYERS PERMISSION 
Gi ve^ student the student! s copy of the employer f6rin , . 

"I have read the employer survey form, understarfcl it and give my 
permission to the interviewer to interview my employer." 



Student* S' Name ^ Date 



Interviewer's Name Date 



•Sourco^ Powers and vJ. Lewis. 1470-1975 Follow-up of Hearing Impaired 

Graduates of Pennsylvania {Bloomsburg, Pennsylvania: Bloomsburq State 
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t 



Dear Parent t * 



9 



The ABC vocational school is conducting a follow-up survey of 
haari^ig ia?>aired young adults. Wiis survey is part '6i an effort to 
gain much needed knowledge about hearing impaired persons, and prbvide . 
some new insights into methods to improve the educational opportunities 

hearing impaired persons, and to aid. in improving their labor 
Jg^ket es^rienees. 

r • * 

fWe hppe that you will assist in our research by a^llowing a qualified 
int«Wiewer to ask you some questions about your son/daughter's vocational 
educational program, and einploymont experiences. All, the information • 
\)^jiqJi.yo\^, give to the interviewer will be held strictly confidential and 
will eniir^ used by those working on. the sttidy to prepare statistical 
summary jinformation. All of the information will be analyzed on .a sunanary 
basis axid no individual or agency will be named. 

■ c 

please sign^and date this letter i-n-^he spaces indicated below and 
return in the enclosed staiqped ^elf -addressed envelope. Your coopera- 
tion and promt* cness will be appreciated. 

I hereby authorise the" ;6c vocational school to conduct an interview 

at ray convenience regarding ^y son/daughter' s ' 

educational program. • * ~ ' ' ' 



Date • Sighed 



Parent 



\ 

♦Source:. G. Pcwers and J. Lewis. 1970-1975 Follow-up of HearAq Impaired 
Graduates of Pennsylvania (Bloansbur'j, Pennsylvania s Bloomsburg State 
College, 1976). 



J' 



■ 



Dear Graduate: 

■'Stxe ABC vocational school is conducting a follow-up svurvey of 
hearing in^aired young adults. This survey is part of an effort to gain 
siuch needed knowledge about hearing is^aired persons, and provide some 
new insights into methods to iii5>rove the educational opportuitities for 
hearing impaired- persons and to aid in iB5>roving their labor market 
e.xperiences'ii . 

We hope that you will assist in our research by allowing a qualified 
interviewer to ask you some questions about your educational program. 
All of the information, which ydu.give to the interviewer will held 
strictly confidential and will only be used by those working on the study 
to prepare statistical^ summary information; All of the information vlll 
be analyzed on a sussiary basis and no individual or agency will be named. 

r 

Please sign and date this letter in the spaces indicated below and 
return in the enclosed staiiped self^^addressed envelope* Your coopera-^ 
tion and prc^ptness will be appreciated* j ^ 

I hereby .authorize, the ABC vocational school to conduct an interview 
at my convenience regarding my educational program, and en^loyit^nt * 
experiences* ^' 



Date Signed 



Graduate 



♦Source: G.^ PowerJs and Lewis, 1970-1975 Fpllow-up of Hearing Impaired 
^ '*J^^d uato<j of Pennsylvania (B16omsburg, Pennsyl'vahia: Bloomsburg State 



APPENDIX C 



D@ar Graduates Cover Letter to 
Accompany the Pollow-up Questionnaire 



4 



). 



) 



/ 



V' 
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SCHOOL LETTERHEAD 

December 12, 197'8 



Dear Graduates • ' • . 

The Department of Eduqation and. the ABC AVTS are' very 
interested in evaluating the vocational educatioa ' . 

programs in the school. ^ 

Your name has been selected to help con^lete the study. 
The 'information you provide will help evaluate vthese voca- ^ 
tional programs with the aim* of improving their effective-, 
ness. " . 

s 

Enclosed is a follow-up form which we arc asking you to 
complete and return in the enclosed* stamped, 'self-addressed 
enve lope All information provided is strictly confidential 
and your name will not be . associated in any way with the 
information you give. By returning the follow-up form, 
you are allowing the information to be counted and analyzed. 

Thank you for your valuable assistance in helping to 
improve vocational education for youth. a.You may ..withdraw 
your consent to tabulate the questijarfifiai're responses at 
any time. Please feel free to cail% me if you have any 
questions about this effort. ..J' * V 

Sincerely, 



Director of Vocational Education 
ABC Area Vocational-Technical School 
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SCHOOL LETTERHEAD 

December 12, 1978 



1 



Dear Employer: 

The XYZ Department of Education and the ABC Area Vocational 
School are ;very interested in evaluating the vocational 
programs in the school. 

Because your company employs vocational education graduates 
we believe the information you provide will help to evaluate 
these vocational programs with the aim of improving their 
effectiveness. 

Enclosed i« a follow-up form which we are asking you to 
complete and return in the enclosed stamped, self -addressed 
envelope. All information provided is strictly confidenti al 

and your name will not be associated in any way with in- 

formation you give. 

» 

Thank you for your valuable assistance in helping to improve 
vocational education for youth. You may withdraw your 
consent to tabulate tHe questionnaire responses at any time. 
Please feel free to call me if you have any questions about 
this effort. 

Sincerely, 



Director of Vocational Education 
ABC Area Vocational School 
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SCHOOL LETTERHEAD 



December 26, 1978 



Dear Enqployer: 

About two weeks ago we mailed you a £ollow-up form concerning 
the evaluation of vocational education at the local area 
vocational-technical school. At that timi we stated that 
all information provided is strictly confidential. 

Many other employers and community contact persons have com- 
pleted and returned their follow-up forms. It seems these 
people have welcomed the opport\;nity to help evaluate the 
vo-tech school's program. However, according to our records, 
you have not returned the follow-up form as yet. 

Because a high rate of response is essential' to the study's ° 
accuracy, we again ask for your assistance. Won't you please 
help us improve the vocational education at the local vo- 
tech school by completing the enclosed follow-up forms and 
mailing them to us? 

For your convenience again, we have enclosed an addressed, 
postage paid envelope. If you have completed it and it is 
on its way, thank you for doing so. 



Yours truly, 



Director of Vocational Education 
ABC Area Vocational-Technical School 
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APPENDIX E 



Student FoX low-up Letter - Third Mailing 



J 
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ABC AVTS FOLLOW-UP 



Third Mailing 




HELPl we're looking for a MISSING 
follow-up 'form. If yovi've returned 
your follow-up fQrm, you've already 
helped and don'.t need to read 'the 
rest of this message. 



You are only one person, but one person can really make a ' 
difference. You can still help us by returning your cbmpleted 
follow-up form today. 

Thank' you. 



Yours truly, 



Vocational Teacher 

ABC Area Vocational Technical School 



P.S. Because we need to keypunch the information during the 
week of January 23rd, I would appreciate your sending the 
completed follow-up form in by then. A mailing label is en- 
closed for your convenience. Thanks. 
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Append^ F 



OE Instructional Codes and Titles Conversion Table: SOC to 
OE Codes Relating- to Vocational Educati'on Programs. 



• 
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dE INSTRUCTIONAL CODES AND TITLES 

OI.OICK) Agriculture Production' 

01.0200' Agriculture Supplles^ervlcfiS 

01i)300 Agriculture Mechanics 

01.0400 Agriculture Products 

01.0500 Ornamental Horticulture 

Ot.QSOO Agricutfire Resources 

01.0700 Forestry ' 

01.9900 Other Agriculture > 



04.02Q0 Apparel & Accessories 

P4.0300 Automotive . 

04.0§00 Finance & Credit 

04.0500 Floristry 

.04.0600 Food Distribution 

04.0700 Food Services 

04.0800 GenerjBl IMerchandise 
04.0900 . Hardware, Buitcling Materials, etc. 

04.1000 Home FumisMni^ •» ^ 

04.1100 Hotel & .Lodging 

04. 1 200 Industrial Marketing 

04.1300 Insurarice 

04.1500 Personal Services 

04.1700 Real Estate 

04. 1 800 ' Recreation & Tourism 

04.1^)0 \ Transportation 

04.2000 Retail Trade, other 

04.9900 Other Distributive Education 

07.0K)1 Dental Assistant 



.0203 <^edical Lab. Assisting 

07.0299 Other Med. Lab. Technol. 

07.0301 Nursing, Associate Degree 

07.0302 Practical (Voc.) Nursing 
-07.0303 Nursing Assistant (Aide) 
07.0399 Other Nursing 
07.0501 Radiologic Technology 
07.C^00 Mental Health Technology 
07 .'0903 Inhalation Therapy Tech. 
07.0904 Medical Assistant 

07.0906 Health Aide 

07.0907 Medical Emergency Tech. 
07.9900 Other Health Occupations Education 



04.0100 



Advertising Services 




Dental Hygienist (Assoc.) 
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01 INSTRUCTIONAL CODiS^AND TITLiS 

09.0201 Care & Guidance of Chlldrtn 
^.0202 Clothing Mgt., Prod., & Service 

09.0203 Food Mgt., Prod., & Service 

09.0204 Home Furn., Equip., Sifv. 
C©.020S tnst. Si Home Mgt, & Sup. 

^.0299, Other Occupational Preparation for Homemaking 

14.01 efO Accounting & Computing ; 

14.0201 Computer & Console Operations 

14.0203 . Programmers 

14.0299 Other Business Data Processing 

14.0300 Filing, Office Machines 
14.0400 Info., Commimic. Occupations 
14.0500 Materials, Support, Transportation, etc. 

•14.0600 Personnel, Training & Related 

t4 0700 Steno., Secy., & Related 

14.08K) Supervisory and Admin. Management 

K.^iOO Typing & Related <^ 

14.9900 Other Office Opcupations Education 

16.0103, Architectural Technology 

16.0104 Automotive Technology 

16.0106 Civil Technology 

16.0107 Electrical Technology 

16.0108 Electro-ijc Twhnology 

16.01 10 Envir^niental Control Technology 

16.0111 I ndus^ii Technology 
1^.01 T3 Mec^]b6j Technology 

1 6 01 1 7 Scientific beta Technology 

16.(^01 Commercial Pilot Training , 

16.^02 Fire & Fire Safety Technology 

16.089S Police Science 

1 6.9902 Water & Waste Water Technology 

16.99Q0 Other Technical Education 

1 7.01 00 Air Conditioning 

1 7.0200 Appliance Repair 

17.0301 Body & Fender Repair 

1 7.0302 Auto Mechanics 
17.04^ Aviation Occupations 

1 7.0700 Commercial Art Occupations 

1 7.0900 Commercial Photography Occupations 

17.1001 Carpentry 

17.1002 Electricity 
17.1C04 Masonry 

1 7. 1009 . Other Construction & Maintenance 

1 7. 1 j 00 Custodial Services 



« 
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Oi INSTRUCTIONAL CODES AND TITLIS 

17.1200 Diesel Mechanic 

17.1 300 Drafting Occupations 

17.1400 Electrical Occuoations 

1 7. 1 §00 Electronic Oecupttions ^ 

1 7. 1 700 Foremanship, Supervision & Management Development 

17.1900 Graphic Arts Occupations 

17.2100 ^Instr. Maintenance & Repair 

1 7.2200 Maritime Occupations 

17.2302 MKJhineShop 

17.2303 Machine Tool Operation 
1 7.2305 Sheet Metal 

17.23(B Welding & Cutting 

17.2307 Tool & Die Making 

17.2399 Other Metalworking Occupations 

17.24CM • Metallurgy Occupations 

17.2602 Cosmetology 

17.2699 Other Personal Services 

17.2700 Plastics & Occupations 

17.2801 Fireman Training 

17.2802 Law Enforcement Training 

17.2899 Other Public Services * 

17.2900 Quantity Food Occupations 
17.3000 Refrigeration 

17.3100 Small Engine Repair 

17.3200 Sta. Energy Sources Occupations 

1 7.3300 Textile Production & Fabrication 

17.3500 Upholstering 

17.3600 Woodworking Occupations 

1 7.9900 Other Trade and Industrial Education 
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r CONVERSION TABLE: 

CODES TO 01 CQDES RiLATINQ TO VOCATIONAL EDUCATION PROGRAMS 

14 MANAGEMENT RfiLATiD OCCUPATIONS 
PersonneCfraining, and Related Occupations 

Managsfrtent Development v o 

OtHer Re«dted 



14.06 00 
17. 3t 00 



17 COMPUTER. MATHEMATICAL, AND OPERATIONS RESEARCH OCCUPATIONS 

Scientific Data Procesiina • - ie ai 

Othef Related 16.0130 



29 REGISfERED NURSES 

Nursing (Associate Degree) 
Other Related 

• t 

% 

32 WRITERS, ARTISTS, PERFORMERS A^JD RELATED WORKERS 

Commercial Art Occupations 
Graphic Arts 

Custom Dracrery and Wir^ovi Treatment 
Designer/Maker 
Commercial Photography 
Other Related/ 

^ 36 HEALTH TECHNOLOGISTS ANO TECHNICIANS 

£ 

Dental Hygienists 
Nuclear Medical Technician 
Radiologic Technician 

Practical (Vocational) Nurje • . 

•Medical taboratory Technician 
Emergency Medical Techniciar. 1,11. Ill ' 

Surgical Technician 
Occupational Therapy Aide 
Rasqiratory Therapy Technician 
Opthalmic Technfcian 
Mental Health Tet^inician 
Otner Related 

"''tE^CHNICUNs' ''^'-ATED TECHNOLOGISTS AND 

Electrical Teahnology ^ 
f iectronic rechnol<^y 
injTrumentation Technology 

Industrial Production Technology ' 

Mechanical Design Technology 

Metallurgical Technology 

Architectural Technology 

Aeronautical Technology 

Civii Technology 

Eii»< frofriBrhani<;al Tpchnolt;gy » 



07. 03 01 



17.07 00 

17.08 01 
09. OS 05 

17.08 08 



07. 01 02 
07. p2 08 
07. 02 07 
07. 03 02 
07. 02 03 
07. 08 01 
(& 02, 03) 
07. 03 04 
07. 04 02 
t)7. 02 12 
07.06 00 
07. 06 00 



16. 01 08 
16.01 09 
16.01 14 
16.01 13 
16.01 25 
16.01 26 
16.01 03 
16. 01 01 
16 01 07 
16. 01 



AiAQmoiive iqyipment Td^fwiogy 
Orsftina Oe^upations 



16.01 04 
17.1200 



m SCIENCE TECHNdLOa<STS AND TECHNICIANS 



^ Chemical Tet^nalaav " 



invlf enmetttal Control Tet^nolsgy 
Other Rsiat^ 



16. 01 06 
le.Cffi 13 
18.01 11 



^ TiCHNiaANS: IXCErr health and SCIiNCi 



Frogramtnan 
Other Rota^ 



14.^02 02 



) ' 



41 SAi.gS OCCUPATIONS, COMMODITliS 

Florittry & ^arm aid Girdsn &Supptio8 M&fkdtifis 
Agri^ltural Supplt«ft/8«^ieis 
Pdtmtoum Mii:i(tttnQ 

Auiomotiva, RKmtidn&i ft Agrieuttural Vehietas & Ae^ftSdries 

Apparat and Aoanoilas 

Homa F umithif^ Markating 

Hardwara & Buitdif^ Matarlals Morkettrtg 

Food Marfcatine 

General Mtrdt\wnd\iQ Retaiiin^ 

intarnational Marketer's 

Retailif^ 

Whoteialir)9 * * <^ . 

Other Related ' ^ 

o 

42 INSURANCE, REAL ESTATE, AND SERVICE SALES OCCUPATIONS 

« 

tniuranra 

Real Estate Marking* 
F f nance ^ Credit Serviesd 
Persdnai Servtoea Marketing 
Transportation & Travel Marketing 
Recreation Marketing 
Hotei/Motel & Lodging Servioes 
Advertiiir^ ft Oii^ay Services 
F ood $erviod$ Marketing 
Other Related 



01.02 00 
04.16(» 

04.03 0i0 
04.02^ 
04.10(» 
04*09 00 
04.06 00 
04.08 00 
04. 14 00 
04.22 01 
04.22 02 



04. 


13 


m 


04. 


17 


00 


04. 


04 


00 


04. 


16 


00 


04. 


19 


00 


04. 


18 


00 


04. 


11 


00 


04. 


01 


00 


04. 


07 


00 



46 SUPERVISORS; CLERICAL OCCUPATIONS 



Ctericd) snd Office Supervisors 
Othp.> Rfilstad 



14.08 04 



4847 CLERICAL OCCUPATIONS. EXCEPT EQUIPMENT OPERATORS 



Stsnographers 

Gensrsi Office. Cler cat & Related 

Information Communication 8t Related Occupations 

Other Raidted 



14. 07 02 
14.07 03 
14. 63 do 
14.04 00 



ERIC 
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47 BOOKKiEPERS, BILLING, ACCOUNTING AND STATISTICAL CLifiKS 

Aeeeuntirtg Related Occupations 14, 02 00 

Otter Rotated 

48 COMPUTING AND OFf^lCE EQUIPMENT OPERATORS 

Computar and Comote Operators « 14. 02 03 

P^riphoril Equipment Operators 14' 02 OS 

Other Related j 

51 PROTECTIVE SERVICE OCCUPATIONS 

Volunteer Fireman i ^9.^00 

fire and Fire S^ety Technol^y • Is! OS 05 

Firefighting Training ^ , 17.22 01 

Police Science Technology 16» ^ 21 

Law Enforcement Training 17. 22 02 
Other Related »y 

52 SERVICE OCCUPATIONS, EXCEPT PRIVATE HOUSEHOLD & PROTECTIVE 

521 Food*& Beverage Preparation and Service Occupations 

FoQd Man^ment, Productions & Services 04 00 

Quantity Food Occupetions 17. 23 00 

Other Related 

523 Health Service Occupation 

Dental A^istants ' ^07.0101 

Physical Therap^ Aide " ^ 07.04 03 

Medical Assistant 07. 08 05 

Environmental Health Assistant 07. 08 06 

Nursing Assistant (Aide, Orderly) 07; 03 03 
Other Related 

524 Cleaning and Buihding Service Occupations Except Private Households 

Custodial Services . 17. 10 01 
Other Related 

525 Personal Service Occupations 

Bartjering 17.21 01 

Cosmetology 17.2102 
Other Related 

526 Child Care Workers* ExD^pt Private Households 

Child Care & Guidance, Man^ment & Service Occupations 09. 02 00 

* Other Related 

FARM OPERATORS AND MANAGERS 

Production Agriculture 01. 01 00 

Agricultural Products, Processing & Marketing 01 . 04 00 

Renewable Natural Resources 01 . 06 00 

Horticulture- 01 . 05 00 
Other Related 
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S7 ^O^iST^y & LOGGING OCCUi^ATtOf4S 



Forestry '^odueti&n 01.07 01 

Forestry TeeHndlatlY . IS.OS^ 
Other Related 

m FlSHEflS. HUNTERS, AND TRAP^fRS 

Commereiaf Fitiiing 17. 18C. 
Other Related * 

61 CONSTRUCT ION TRADES 

Masonry (T rowdl Tri^as) 17. 09 02 

Carpemry ^ 17.^01 

Eleetridty 17. 10 02 

Flumbin§ and Pipefitting 17. 09 10 
Other Related ^ 

^ 

TRANSPORTATION OCCUPATIONS 

« 

Ship ancj Soat Operation and Maintananoe 17. 18 03 

Seamanship 17.1802 

Aviation Oeeupations 1 7 . 05 00 
Commereidt Pi tot Trainir^ . 16. 05 03 
Othar Related 

67 MECHANICS AND REPAIRERS 

AutomotivQ Meehanie ■ ^ 17.0301 

Small Engine and Ch^ia Repair ' 1 7. 24 01 

Automotive Body Mechanic 17. 04 01 

Farm Medionics 01 . 03 00 

Motor Repair 17.03 00 

Diesel Equipment Mechanic 1 7. 1 1 01 

Industrial Atomic Energy 17. 16 00 

Stationary Energy Sources Occupations 1 7 . 15 W 

Appliance Repair Oeojipations ^7. 02 00 

Heating & Air Conditioning 17. 01 01 

Cooling Si Refrigeration 17. 01 02 

Instrument Maintenance it Repair Occupations 17. 17 00 

Business Machine Maintenance 17.06 00 

Electronic Occupations 17. 14 00 
Other Related 

72 PRECISION PRODUCTION OCCUPATIONS 

Machine Shop 17. 19^04 

Toot and Die Making 17. 19 05 

Sheet Metat 17. 19 07 

Machine Tool Operation 17. 19 03 

Woodworking Occupations 1 7. 28 00 

Aiteraiionist 09.03 03 

Custom Apparel/Garment Seamtress 09. 03 06 

Upholstering 17.27 00 

Custom Upholster and Slipcover 09. 05 04 

Leatherworking 17. 26 00 

Textile Production Fabrication & Maintendnoe Occupationti 1 7. 25 00 

Derital Lal)oratory Technician 07, 01 03 
Ot.jer Related 
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77 FABRICATOR. ASSiMSLiRS. AND HAND FINISHiRS 
Combination Welding 



iteetrieWehiing 
QthQT Reiated 

SeOCCUF^TIONi NOT ELSEWHERE CLARIFIED 

Qccupation of Homem^inQ 

Other, Unpaid Empioyntent or Volunts«r 
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Appendix G 
Award Winning Follow-up Brochure 



ft 



-267- 




AIMIPOITTS* 





HR3HLJSHT 
RESULTS 
OFA 

SURVEY OF 

PHILACELPHIA 
PUBLIC 
HIGH SCHOa' 
PUPILS 



SCHOOL 
IN 1974/^^3 

IhsKVISIOII QP4MmrOTUm^6UKWlAS8A»CH mnCiS t OFFICE OF SBSBARCH^ EVALUATION 
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lARE YOU WORKING?! 

ARE VOU 
UNEMPLOYED? 

I 

ARE YOU ^LOOKING 
FOR WORK? 

ARE YOU BACK 
IN SCHOOL NOW? 
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lARE' YOU IN THE 
ARMED FORCES? 



WHAT WERE YOU 
REASONS FOR 
LEAVING SCHOOL 



WITH WHOM DID 
YOU TALK ABOUT 
LEAVING SCHOOL? 




TM6S6 RESULTS OF TH6 FIRST SURVEY 
OF PHIUOELPHIA PUBLIC HIGH SCHOOL 
DROPOUTS WERE OBTAINED FROM 
1,306 RESPONSES 



QUESTIONNAIRES WERE * 
MAIIED IN SEPTEMBER m% 
TO ALL THE t974-7S DROPOUTS 
LISTED IN THE PUPIL 
DIRECTORY FILE ' 




CP THE 
1.306 

RBSPOHDEHTS 
OCTOBER.te75 




22% WERE WORKING AND 

NOT ATTBNDINC SCHOOL 

4% WERE WORKING 

AND ATTENDING SCHOOL 



t,9\ WERE UNEMPLOYED 

fi6% OP THE UNEMPLOyEO 

WERE LOOKING FOR WORK 



l^t WERE NOT WORKING AND NOT 
. LOOKING FOR WORKc 
(DISCOURAGED WORKERS, 
HOMEMAKERS) 



20% WERE BACK IN SOME 
EDUCATIONAL PROGRAM 



9% WERE IN THE ARMED FORCES 
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OP THE 341 
RESPONDENTS 



ALMOST ONE-THIRD OF THE RESPONDENTS WHO 
WERE WORKING HELD UNSKILLED JOBS 




AN ADDITIONAL 22% WERE IN SERVICE OCCUPATIONS. 
(WAITRESS^ GUARDS. ETC.) 

CRAFTSMEN AND OPERATORS, INCLUDING 
APPRENTICES. CONSTITUTED 9% OF THE TOTAL 

m WORKED IN OFFICE JOBS 

A SLIGHT DIFFERENCE IN HOURLY 
EARNING? WAS REPORTED BETWEEN 
BLACKS AND WHITES («.50) 

A GREATER DIFFERENCE IN HOURLY 
EARNINGS EXISTED BETWEEN MALES 
($2.S8) AND FEMALES ($2.34) 




OF THE 533 

LOOKING FDR 
WORK 



OF THE 262 
RESPONDENTS 
IN SCHOOLS 



in WANTED OFFICE WORK 

5% WANTED WORK IN HEALTH SERVICES 

14% WANTED JOBS IN SERVICE OCCUPATIONS 
(I.E.. TEACHER AIDES, NURSES AIDES AND 
NON-TEACHING ASSISTANTS) 

411% WANTED ANY KIND OF JOB 



22% WERE EMPLOYED 

6.1% WERE WORKING FOR THEIR GENERAL 
•HIGH SCHOOL EQUIVALENCY DIPLOMA (GEO) 



28% WERE ATTENDING PHILADELPHIA STANOAI^D. ) 
EVENING HIGH SCHOOLS 

23% WERE- IN PRIVATE HIGH SCHOOLS 

9% WERE IN TECHNtCAL OR TRADE SCHOOLS 

8% WERE IN FEDERAL PROGRAMS 




O 

ERIC 
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OP 1.003 
ANSWERS 




111 


RETAINED GRADE 

» 


■4' 

14 


NEEDED OR COT A J08 




PREGNANCY, MARRIAGE, OR BABY CARE 


12 


PERSONAL OR HOME PROBLEMS 


21 


POUND SCHOOL "BORING AND A HASSLE" 


e 


POOR ATTENDANCE, "GOT PUT^UT"' 


3. 


•CWIT - WASN'T LEARNING" g 


3 


G0VERNMEN1 SERVICE (JOB CORPS - 
ARMED SERVICES ETC 1 


2 


UPT TO GO TO ANOTHER SCHOOL 


a 


"GANGS" 


n 


DESIRED COURSES NOT AVAILABLE 


* s 


OTHER 


loot 





■WITH WHOM DID 
YOU TALK ^OUT 
LEmi^Q SCHOOL? 

Almost a third of the respondents said they spoke to no one about 
their decision to leave school . More than half said they did not talk 
to any school personnel before they dropped out. More than a third 
talked to counselors and a fifth talked to other school personnel 
and family as well . Almost a quarter of these respondents consulted 
only their families, and almost as many consulted with both family 
and school personnel. 



THE DROPOUT3 1974- TS 
TOE GRADUATES 1974 



J. HIGHLIGHTS 
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DROPOUTS 


GRADUATES 


EMPLOYED (EXCLUSIVELY) 


22% - 


29% 


MEDIAN HOURLY WAGE 


1 12.47 


il.38 


UNEMPLOYED - LOOKING FOR 






WORK , 






MILITARY SERVICE ' 


9 


' T- 


IN SCHOOL OR COLLEGE 


20 


Sfi 


ULAC^ 


6H 


54 


NON -BLACK 


36 " " 


"4« 


MALE 


, 57 


4S 


FEMALE 


43 


Si, 
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THE QUESTIONNAIRE,.. 
A SIMPLE POST CAUl> 

Tht* survey shows that dropouts, 
though a more mobile group than 
yraduatc^ (tw^ce as^ many drop . 
uut qufe^itioVinairts were undelivered 
by thkj Postal Service) , and perhaps 
d yroup less kindly disposed toward V* 
the Philadelphia Pabltc School 
System, responded to a survey 
at a rati* sufficient ^o yield an ^ 
adequate number of responses * 
tor afUily.siN purposes^ The responses 
were repr^*-fit%jti ve ut the yruup 
contuctecl • 



PUASS COMPUrrS. TIAR off, ANO mail IMMiOtATfitV THANK YOU 

ft tJffH' 



Aft you worKing now * 

Aft you yntmploytd^ 
Aft you looHiftg for mork^ 
If wrhtl 



□ Yt» 



♦4tvt you htd d job %ir»ct tetvin^ high »c^M>oP 
If yt». wh«t kind*^ : . 



DVe* □ No 



Witt) whom M you talk About Ittvtng tchooP (Chtcl til thtt opply ) 
Ccounwlof Qlttchtf D Ff ifKiptl/Vict Pf inciptl 

Drtmily □ No ont Q Olh*f , 

t^hy did you ttave school tttloru g*-^^*"*!!^ ' 



Art you going to-tchool now^ 



C0Mf»t^ 



-□C£0. 



.□T0ch/tf«dt- 



Othtf. 



NOTICE TO PARKNTS OR GUARDIAN 

If tht p^rten to whom ihit it iddf otMd it m the tfmtd forcts . ploatt chtcK htre , 
SCHOOU DISTRICT OF PMIUAOtCPMIA • 0>f\Ct OF RESEARCH t EVALUATION 



CONCLUSIONS 




A number of unsolicited 
comments from the re 
spondents indicated an 
awareness that they had 
■•^''messed things up.** Al 
though they had been re- 
tamed m grade one or 
more times, some dropouts 
wanted help in returning to 
school Many expressed . 
thanks for our interest 
in them 



10 



The reasons for dismissal 
coded on the individual 
school records differ con- 
sidef'abl/ from the reasons 
given by the dropouts in 
this survey. Although school 
records show the students 
were leaving school to go to . 
work, many of them left 
because they were dissatis- i 
fied with their progress in 
school Among th>e respon- 
dents whose r<*cords show 



they left school in order 
to go, to work, 11% reported 
that their reason for leaving 
school was that they were 
retained in grade*. An 
additional 17% of this group 
said that they left school 
because i^ "was boring and 
a hassle." In fact, only 20% 
of these respond.ents stated 
in the survey that they left 
school to go to work. 







197«-75 
DROPOUTS 


-MPLOYED (EXCLUSIVELY) 


28% 


22% 


. MEDIAN HOURLY WAGE 


.$2.21 


$2. '♦7 


UNEMPLOYED - LOOKING FOR 

WORK 


35% 


42% 


MILITARY SERVICE 


13 


9 


IN SCHOOL OR COLLEGE 


16 


. 20 _ 



-272- 



THf SCHOOL DISTRICT OF PHIUADEtPHiA 

DR.- MICHAEL "P. MARCASE. Superintendent of Schools 

MR.. OAVIO A. HOROWITZ. Deputy Superintendent 
fi^ Sehool Services 

MEMBERS OF THE BOARD Of EDUCATION 
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MR. AUGUSTUS BAXTER 
MRS. LAWRENCE BOONIN 
OR. PHIUP DAVIOOFF 
MR. GEORGE HUTT • 
ROBERT M. SEBASTIAN. ESQ. 
MRS. MICHAEL STACK 
GEORGE PHIUP STAHL. JR.. ESQ. ' 




This report prepared by* 

Ms. Ediths. Kemp. Research Associate 

Or. Michael H . Kean. 

Executive Director ^ 

Office of Research and Evaluation 

Mr. Edward B. Penry, Director 
Division of Administrative 
and Survey Research Services 



Copies of both this summary brochure and 
a more detailed report are available from the 
Office of'informational Services, 299-7850. 
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